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SYNOPSIS 


This thesis presents a generalized theory of permuta- 
tion-invariant (P-I) systems that find applications in the 
processing of finite discrete data. The existing theory of 
such systems deals exclusively with only the one- dimensional 
kind which accept finite-length sequences of reals as their 
input signals and which are the finite discrete counterparts 
of one- dimensional (l-D) linear shift- invariant (LSI) systems. 
The material presented in this thesis is an extension and 
generalization of the existing theory and covers two-dimen- 
sional (2-D) P-I systems whose input signals are finite 2-D 
arrays of reals, and also those P-I systems whose input 
signals are finite-length sequences with entries drawn from 
finite fields and rings of residue class integers. Having 
features similar to those of 2-D LSI systems and linear 
sequential circuits, these new categories of P-I systems are 
expected to have analogous applications in signal pro cessing. 

A l-D linear system whose input and output signals are 

pfeljrrousty 

finite sequences of some arbitrary length N, has earlier been 
defined to be permutation- invariant relative to a transitive 
abelian group of permutations G- of order N, if the effect of 
permuting its input signal by any member of G is to permute 
the output signal also in the same manner. By analogy, a 2-D 
P-I system is defined here as a 2-D finite discrete linear 
system that exhibits invariance to certain kinds of permuta- 
tions of the rows and columns of its input signal. To be 



specific, let G-^ and G -2 be transitive abelian groups of permu- 
tations of orders m and n respectively. Then, a 2-D linear 
system which accepts input signals given by finite arrays or 
matrices having m rows and n columns, is defined to be permu- 
tation-invariant relative to the groups and G- 2 , if the 
effect of permuting the rows of its input signal by any member 
of G-^ and the columns of its input signal by any member of G -2 
is to permute the output signal also exactly in the same 
manner. All 2-D P-I systems defined relative to the same pair 
of groups, G-^ for the rows and G -2 for the columns, are said to 
form a clas's of 2-D P-I systems relative to and (^ 2 * ^ 

familiar example of 2-D P-I systems is provided by the 2-D 
cyclic convolutional systems which can be shown to have permu- 
tation-invariance property with respect to cyclic permutations 

The basic structural properties of 2-D P-I systems are 
expectedly the same as those of 1-D P-I systems except that 
they are centrally dependent upon two transitive abelian 
permutation groups rather than just one. Specifically, like 
the 1-D P-I systems, a class of 2-D P-I systems is characte- 
rized by a well-'def ined convolutional formula, a family of 
eigen^vectors and a 2-D discrete transform. Each of these 
characterizations has been dealt with here in detail and 
several important results pertaining to them have been esta- 
blished. The arguments used in establishing these results 
are in spirit similar to those used in the case of 1-D P-I 
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systems. However, since the input and output signals of 2--D 
P-I systems are matrices rather than column vectors, a more 
formal approach has been used. In the present approach, 
signals are treated as members of the vector space V of real 
m X n matrices and systems are treated as linear transforma- 
tions on this vector space. With signals and systems so 
treated, it is shown that a class of 2-1 P-I systems defined 
relative to groups G-^ and 0-2 forms a vector space whose dimen- 
sion is the same as that of the pertinent signal space V of 
that class. Moreover, if B. . denotes the transformation or 

1 J 

operator whose action on any 2-1 signal XeV is to permute its 
rows by the permutation Pj_sGr 2 _ sJid. the columns by the permuta- 
tion q.eGr 2 , then the set of operators ^B.ere 

denotes the set of integers 0 to (k-l), forms a basis for 

this vector space. By recognizing that these B. . 's are normal 

^ J 

operators, it is shown that all 2-1 P-I systems of a particulai 
class have in common a set of N linearly independent ortho- 
normal eigefT^vectors, where N = m, n. This equivalently means 
that each class of 2-1 P-I systems has associated with it, a 
2-1 finite discrete transform (2-1 PIT) which leads to the 
notion of transfer functions for 2-1 P-I systems. In essence 
a generalization of the 2-1 discrete Fourier and Walsh trans- 
forms (2-1 IB'T and 2-1 IWT), the 2-1 PIT for every class satis- 
fies a generalized convolution theorem. 
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After developing the theory of 2~D P-I systems as an 


independent entity, attention is given to the relationships 
between 2-D and 1-D P-I systems. A key result in this context 


is that, for every class of 2-D P-I systems, there is an 


equivalent class of 1-D P-I systems. This result is obtained 


in three stages. Firstly, methods are examined for trans- 


forming 2-D signals into 1-D signals with the help of appro- 


priate one-to-one index mappings f : Z x Z -► Z„, N = m.n. 


IText, considering an arbitrary 2-D signal XeV, it is shown 


that permuting its rows and columns respectively by members 


of transitive abelian groups of permutations and G 2 is in 
effect the same as permuting the equivalent 1-D signal xeR^ 


by the members of the transitive abelian permutation group G 


which is characterized to within an isomoriphism by the external 


direct product of G^ and G 2 . A general procedure for constru- 


cting the members of G, valid for any one-to-one index mapping 


f : Z X Z Z„, ha.s been outlined by writing down kronecker 


products of matrices in such a way that the rows and columns 


of the product matrix are ordered not lexicographically, but 


in accordance with the pertinent index mapping f under consi- 


deration. Utilizing these results, it is finally shown that 


every member of a class of 2-D P-I systems defined relative 


to G^ and G 2 has an equivalent 1-D P-I system defined relative 


to G. 
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The fact that every 2-D P-I system has an. equivalent 

1- D P-I system gives rise to interesting possibilities in the 
processing of 2-D finite discrete data. It is to be noted 
that the design of stable 2-D LSI systems and 2-D digital 
filters directly from 2-D specifications is beset with pro- 
blems of spectral factorization of polynomials in two variables. 
A number of methods have therefore been proposed in the past 
for the design and implementation of 2-D digital filters indi- 
rectly by using 1-D techniques. These methods, however, are 
limited in their effectiveness by the fact that the exact 1-D 
implementation of a 2-D LSI system or a 2-D digital filter is 

a 1-D filter that does not possess the time-invariance pro- 
perty. As shown in this thesis, no such limitation exists in 
the case of P-I systems, in that, a 1-D system that is an exact 
equivalent of a given 2-D P-I filter retains the permutation- 
invariance property. Further, if the 2-D data to be processed 
are finite, a digital filter may be interpreted as a P-I 
filter, so that for finite discrete data, it is possible to 
convert a 2-D filtering problem into an exactly equivalent 1-D 
filtering problem by resorting to P-I system theory. These 
facts have been discussed in detail in the general context of 
filtering 2-D finite discrete data in Fourier and Walsh domains 
using P-I systems. 2-D Walsh domain filtering corresponds to 

2- D dyadic P-I filtering, and the 1-D equivalent of a 2-D 
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dyadic P-I filter is a 1-D dyadic P-I filter, likewise, it 
is shown that the 1-D equivalent of a 2-D Fourier domain 
filter is a 1-D cyclic P-I filter provided the numher of rows 
and the number of columns of the pertinent 2-D signals are 
relatively prime. 

Attention is next given to those P-I systems whose in- 
put sequences are of finite length n, with entries drawn from 
(i) finite fields, and (ii) rings of residue class integers. 
For convenience, these systems are respectively referred to as 
P-I systems on finite fields and P-I systems on rings. The 
main concern here is the transform domain theory of these 
systems, their sample domain behaviour being largely the same 
as that of 1-D P-I systems with real field inputs. The n-th 
roots of unity in finite fields and rings play an important 
role in the study of cyclic P-I systems of these types. The 
existence of these roots is accordingly first examined in 
detail and procedures for determining them are discussed. 
Cyclic P-I systems on finite fields and rings are then chara- 
cterized in terms of their eigen signals and discrete trans- 
forms. These results for the cyclic class are then extended 
to general classes of these P-I systems and a characterization 
is given for them in terms of their respective eigen signals 
and generalized discrete transforms. It is observed that for 
appropriate choices of the modulus of the residie class ring. 
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the traiisforms defined by the corresponding class of cyclic 

P-I systems give rise to the so-called number- theoretic 

transforms (NTT’s) such as the Mersenne number transform and 

the Fermat number transform. • These NTT's have been proposed 

in the last few years primarily as a means of efficient and 

error-free computation of cyclic convolution. Looking at 

(Xy 

these transforms from system- theoretic point of view, it 
is shown in this thesis that just like the IFT and the D¥T, 
the NTT's also have associated with them a specific class of 
P-I systems, the pertinent class of systems in this case 
being the class of cyclic P-I systems on rings of residue 
class integers. It is hoped that the generalized transforms 
derived here for different classes of P-I systems on rings 
would prove helpful in the evolution of nexrer varieties of 
NTT's having dyadic and such other non-cyclio convolutional 
properties. 



CHAPTER 1 


INTRODUCTION 


1,1 Sco pe of the Wor k 

In this thesis, certain generalizations of permuta- 
tion-invariant linear systems (P~I systems) are studied. 

The existing theory of P-I systems deals exclusively with 
the one- dimensional (l-D) variety having real-field inputs. 
In other words, it deals only with those finite discrete 
linear systems which have finite sequences of reals as 
their input signals and which exhibit invariance to permuta- 
tions of the input signal by members of a- transitive abelian 
permutation group. 

The generalizations studied in this thesis pertain to 
the following three new categories of P-I systems! 

i. Two-dimensional (2-D) P-I systems which have finite 

2- D arrays of reals as their input signals^ 
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ii. P-I systems on finite fields, i.e., those 1-D P-I 
systems whose finite-length input sequences have 
their entries drawn from finite fields, and 

iii. P-I systems on rings, i.e., those 1-P P-I systems 
whose finite-length input sequences have their 
entries from rings of residue class integers. 

The motivation for the extensions covered by the first 
two categories, viz., 2-D P-I systems and P-I systems on 
finite fields, is provided by the fact that in the case of 
the linear shift- invariant (LSI) discrete-time systems, which 
originally served as the model for developing 1-P P-I systems 
[ 1 j , there are in addition to the l-P variety, two other 
equally important varieties whose theories are hi^ly develo- 
ped and well established. These are the 2-D LSI systems exem- 
plified by 2-D digital filters and the finite field LSI 
systems exemplified by linear sequential circuits. Inasmuch 
as 1-D P-I systems are finite discrete counterparts of 1-D 
LSI systems, it is natural to expect the existence of 2-D P-I 
systems and finite field 1-D P-I systems with features 
similar respectively to those of 2-D LSI systems and finite 
field LSI systems and having roles analogous respectively to 
those of 2-D digital filters and linear sequential circuits. 

The third category of P-I systems, viz., P-I systems 
on rings, is suggested by the so-called number- theoretic trans 
forms (DTT's) that have been proposed during the last few 
years. These NTT's with discrete Fourier transform (DPT) -like 



3 


structure, have been proposed as computational aids for the 
purpose of efficient and error-free computation of cyclic 
convolutions. However, the fact that the IFT is associated 
with the cyclic class of 1-D P-I systems with real-field 
inputs, suggests that the HTT's also have associated with 
them, a specific category of P-I systems whose finite-length 
input sequences have entries from rings of residue class 
integers. P^^rther, since the EPT turns out to be a special 
case of a larger family of generalized transforms defined by 
general classes of 1-D P-I systems with real field inputs, it ' 
is reasonable to conclude that a study of general classes of 
1 -D P-I systems of this new Category would give rise to a 
more general family of number- theoretic transforms, idiich v 

will include as a special case the present NTT's having cyclic 
convolutional property. 

Historically, P-I systems have evolved as a generali- 
zation of the well-known cyclic and dyadic convolution "systems 
[2, 3] and a comprehensive theory of various classes of 1 -D 
P-I systems is available in [ l ]. A brief summary of this 
theory of P-I systems is given in Appendix A* 

Of the various classes of 1-D P-I systems, only the 
cyclic and dyadic classes have been found to have a signifi- 
cant role in the processing of finite discrete data. The 
question then naturally arises whether the other classes of 
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1- D P-I systems have any useful role to play. As the results 
of this thesis show, most of those 1-D P-I systems which "be- 
long neither to the cyclic nor to the dyadic class are, in 
fact, the 1-D equivalents of two-dimensional or multidimen- 
sional cyclic or dyadic P-I systems. Thus, while these other 
classes of 1-D P-I systems may not directly be of use in the 
processing of 1-D signals, they are indirectly of practical 
use in the processing of two-dimensional and multidimensional 
finite discrete data. Several methods [ S, 7, sjhave been 
suggested in the recent past for the use of 1-D techniques to 
achieve 2-D tasks in an attempt to overcome the problems of 
spectral factorization [ 8 - 12 ]arising in the design of stable 

2- D digital filters directly from 2-D specifications. However, 

a basic limitation of all these methods is that the exact 1-D 

equivalent of a 2-D LSI system or a 2-D digital filter is a 

1-D system that does not have the shift-invariance property, 

[ 13 ], A 1-D LSI realization of a 2-D digital filter can 

therefore be at best an approximation. As the results of this 

thesis show, no such basic limitation exists in the case of 

i S 

P-I systems and when the data to be processed 931 ^ finite, 
exact 1-D realizations of 2-D filters can be obtained using 
the P-I system approach. 

Computation of convolutions via the DFT became attra- 
ctive following the availability of the fast Fourier transform 
(PFT) algorithm [ 14 ], However, the DPT involves complex 
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multiplications and additions that are inherently slow and 
inaccurate. The fast Courier transform in finite fields [15] 
and the various NTT’s [16-I8] have been proposed in the 
last few years mainly as computational aids that avoid the 
deficiencies of the IFT mentioned earlier. Research work on 
these transforms appears to be wholly directed towards their 
computational aspects [l9-2l] rather than a system-based 
study of these transforms. By using a system- the ore tic 
approach, it is shown in this thesis that all these transforms 
are special cases of certain generalized transforms defined 
by P-I systems on finite fields and on rings. 

1,2 .Qnyiini^ ,,of _Chaptj^^ 

The notion of permutation- invariance in two dimensions 
is introduced in Chapter 2 making use of the relevant concepts 
pertaining to the 1-D P-I systems as guidelines* The input V 
and output signals for 2-D P-I systems are finite 2-D arrays 
or matrices while those for 1-D P-I systems are n-tuples or 
column vectors. Therefore, two transitive abelian permuta- 
tion groups and ^2 of appropriate orders, with for the 
set of rows and G2 for the set of columns, are used for defi- 
ning a class of 2-D P-I systems. Specifically, such a class 
defined relative to the pair of groups G^ and G2 comprises 
the set of all 2-D finite discrete linear systems which 
exhibit invariance in their input-output behaviour, to 



6 


permutations of the rows and columns of their input signals 
by members of G-^ and G -2 respectively. Characterization of 
each class of these 2-D P-I systems is then obtained in terms 
of a convolutional formula^ and a common set of linearly 
independent orthonormal eigenvectors which span the pertinent 
signal space for that class. In obtaining these results, 
owing to the fact that the input and output signals for 2-D 
P-I systems are matrices rather than column vectors, a more 
formal approach than what was needed in the 1-D case, has 
been used. In this approach, signals are treated as members 
of a vector space and systems are treated as operators on 
this vector space. 

Relationships between 2-D and 1-D P-I systems are 
examined in Chapter 3. A significant result obtained in this 
context is that for every class of 2-D P-I systems, there is 
a corresponding class of 1-D P-I systems. As a first step in 
obtaining this result, some convenient methods are suggested 
for obtaining an equivalent 1-D signal xeR^ for a given 2-D 
signal XeV, the space of real m x n matrices, in terms of 
appropriate one-to-one index mappings f: x Z^-*» Zj^ ; 

N = m. n^which could also be interpreted as linear transfor- 
mations Q: V ■+• Next, it is shown that the effect of per- 

muting the rows and columns of a 2-D signal XeV by some arbi- 
trary members of and respectively, is the same as per- 
muting the equivalent 1-D signal xsR^ by the corresponding 
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member of a set of IT permutation matrices. This set of per- 
mutation matrices is then shown to form a transitive abelian 
permutation group G- which is isomorphic to the direct pro- 
duct of Gr^ and Gr 2 » Utilizing these results, it is finally 
shown that for every member of a class of 2-D P-I systems 
defined relative to and G 2 » iUere is an equivalent 1-D 
P-I system in a class defined relative to G, A method for 
constructing the members of G is outlined. In this method, 
which makes it possible to provide a unified treatment of 
the results pertaining to 2-D to 1-D equivalence, Kroneckor 
products of matrices are written down following an ordering 
of indices that corresponds to the pertinent index mapping f 
under consideration. Finally we obtain expressions for the 
eigenvalues and eigenvectors of an equivalent 1-D P-I system 
in terms of those of a given 2-D P-I system. 

Chapter 4 deals with the transform domain description 
of 2-D P-I systems. Expectedly, the various results obtained 

Y! 

here follow essentially the same patter^ as the corresponding 
results for 1-D P-I systems. The result obtained in Chapter 
2, that a class of 2-D P-I systems has a common set of line- 
arly independent orthonormal eigenvectors that span the per- 
tinent signal space for that class, is utilized here to derive 
generalized 2-D finite discrete transforms (2-D FDT). It is 
shown that the familiar 2-*D DPT and 2-D D¥T are special 
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of the 2-D FDT, Also, just as 2-D ]1''T and 2-.D D¥T 
satisfy convolutional theorems pertaining to their respe- 
ctive classes, 2-D FDT also satisfies a generalized 

convolutional theorem. The 2-D FDT associated with each 
class leads to the notion of transfer functions for 2-D 
P-I systems. 

In Chapter 5 , the idea of using 2-D P-I systems for 
filtering 2-D finite discrete data is explained. Besides 
discussing various aspects of 2-D P-I filtering in general, 
particular attention is given to the separable type of 2-D 
P-I filters. Their sample domain and transform domain 
behaviour'; and their characterizations are also discussed. . 
Methods ^of designing separable 2~D P-I filters are examined 
and examples illustrating the implementation of separable 
filters of cyclic and dyadic classes are given. 

Chapter 6 deals with a general method of 1-D imple- 
mentation of 2-D P-I filters with special reference to the 
cyclic and dyadic classes. This method of 1-D implementation 
is applicable irrespective of whether the given 2-D P-I 
system is separable or not and it is based on the results ob- 
tained in Chapter 3 concerning the equivalence between 2-D and 
1-D P-I systems. Appropriate index mappings required for ob- 
taining the equivalent 1-D P-I system have been derived 
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for each of these classes of systems and a number of examples 
are given illustrating the various techniques involved in this 
method of implementation. 

Two new categories of 1-D P-I systems are considered 
in Chapter 7. These are l-D P-I systems whose input sequences 
of some finite length n have their entries from (i) finite 
fields and (ii) rings of residue class integers. The main 
emphasis here is on the transform domain properties of these 
systems since it is in this domain that they differ from the 
1-D P-I systems with real field inputs. First, cyclic 
classes of systems of these categories are considered and 
their characterizations in terms of finite discrete trans- 
forms, are obtained. As the eigenvectors of the cyclic class 
of systems have the n-th roots of unity as their entries, the 
question of existence of these roots in the finite fields and 
rings is examined first, and detailed methods for determining 
them are discussed. Using standard results in group theory 
[22-29 results for the cyclic classes of systems are then 
extended to general classes of these categories of P-I systems 
and their characterizations in terms of generalized finite 
discrete transforms are obtained* It is observed that the 
PDT defined by the cyclic class of P-I systems may be used 
with appropriate choices of the modulus of the ring, to obtain 
the familiar types of the so-called number-theoretic trans- v' 
forms (UTT's) , 
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Finally in Chapter a summary of the results pre- 
sented in this thesis is given along with suggestions for 
further work, 

1.3 Ter ming lOiSv a nd M'otation 

In this section we explain the terminology and pota- 
tion used in this thesis, 

where k is some arbitrary positive interger, de- 
notes the set of all non-negative integers less than k* 

Thus f 1,2,.,., k-^ * 

V denotes the signal space of 2-D P-1 systems and is 
the vector space of real m x n matrices, where m and n are 
some arbitrary positive integers. Its dimension is N = m.n. 

The set ^ j ^ matrices, where each 

A. . is ajjm X n matrix with a 1 in the i,j-rth position and ' 
X, J 

zeros everywhere else, denotes a basis set, called the stan- 
dard basis set, for the space "V. 

represents the vector space of real H-tuples and 

the set of IT vectors e^, where each e^^ is a column 

1 

vector of length IT with a 1 in the i-th place and zeros every- 
where else, fohms a basis set, called the standard basis set, 
for the space R^. 
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The upper case letter X is in general used to denote 
the PDT of a signal represented by the lower case letter x, 
where x may be either a 1-D signal or a 2-D signal, as spe- 
cified in any particular context. However, in Chapter 3, in 
dealing with the equivalence between 2-D and 1-D P-I systems, 
it has been found convenient to use the upper case letter X 
to denote a 2-D signal belonging to V and the lower letter x 
to denote a 1-D signal belonging to 



■CHAPTER 2 


2-D EERMUTAT ION- INVARIANT LINEAR 
SYSTEMS 


2-D P-I systems form a subset of a broader class of 
systems called 2-D finite discrete linear systems. Ve begin 
in section 2,1 with a brief study of this broader class of 
systems and the associated signal space. In section 2.2 we 
introduce the notion of permutation- invariance in two dimen- 
sions and later give a formal definition of 2-D P-I systems 
using as a guideline, the notion of 1-D P-I systems introduced 
earlier Cl], Characterization of 2~D P-I systems in terms 
of their unit response matrices and system eigenvectors forms 
the contents of the remaining sections of this chapter. 


2,1 Finite Di screte 2-D Signals and Sys te ms 

A finite discrete 2-D signal is a matrix or a double- 
indexed array of numbers with each one of the indices running 
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over a finite index set. When viewed in this manner, a 2-D 
signal is essentially a function fi ^ where m and 

n are arbitrary positive integers, is the index set con- 

> t « y 

sisting of the integers 0,1, — , (k-l), and R denotes the 
real line. With the usual componentwise addition and scalar 
multiplication by reals, the totality of 2-D signals constitute 
the vector space V of real m x n matrices. This space has a: 
dimension m.n and the matrices ieZ » , where each 

JL y ^ iXX ^ X J. 

A- . is £8)m X n matrix with a 1 in the (i,j)-th position and 
j 

zeros everywhere else, constitute for it a basis, called the 
standard basis. This signal space will henceforth be denoted 
by V throughout the thesis. 

By a 2-D finite discrete system w'e mean a system whose 
input and output signals are from V. Such a system T is thus 
a transformation T; 7 -^7, and if it is linear then it is 
completely characterized by the matrices 


T. . 


^ T( 


-) 

3 


ieZ , 

m' 


jeZ. 


n 


which are referred to here as the standard response matrices. 
Indeed, following the usual arguments for linear transforma- 
tions, we have for any input . xe7, the output y given by 


y = Tx 


m-1 

n-1 

m-1 

n-1 

T I 

1 x-i .• 

^ = y 

T X. 

i =0 

3=0 

i »3 j_ho 

3=0 
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This means that from a knowledge of the standard response 
matrices T. .'s, the output for any input x is completely 
determined. 

Rem ark 2.1.1; By analogy with the unit impulse sequence or 
the unit sample sequence of the discrete LTI systems, the 
m X n matrix q with a 1 in the (o»0)~‘tkL position and 
25eros everywhere else, is taken here as the unit sample signal 
for the 2-D finite discrete linear systems. 


2.2 


2~D Permutation- Invariant Systems 


A system whose input and output signals are of the 
form x(t), - »><t<+ «*, is said to he time- invariant, if the 
consequence of shifting the input signal x(t) on the time 
scale is to produce an exactly identical shift in the output 
signal. Vi/hen dealing with finite discrete signals such as n- 
tuples of reals, the notion of time-invariance is replaced hy 
the analogous notion of permutation- invariance. Thus, a 1-D 
finite discrete linear system T is defined (Appendix A) to be 
permutation- invariant relative to a transitive abelian permu- 
tation group G-, if as a result of permuting its input signal 
by any member of G- the output also gets permiited exactly in 
an identical manner. 
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A 2-D finite discrete signal xeV is an array •with, m 
rows and n columns. In*asmuch as a permutation is a rearrange- 
ment of the members of a finite set of discrete objects, we 
may regard the m rows and n columns of x as two such finite 
sets of discrete objects and so permute each of them indepen- 
dently. let T be a 2-D finite discrete linear system on V. 
Suppose xeV is an arbitrary input signal to this system. 

Suppose further, that we permute the rows of x by members of a 
transitive abelian group of permutations of order m and 
the columns by another transitive abelian permutation group 
of order n. If the effect of all such permutations to the 
rows and columns of x is that in each case, the rows and 
columns of the output signal of the sjrstem T get permuted 
exactly in the same manner, then T is invariant to such permu- 
tations and in this sense we say T is a 2-D permutation-inva- 
riant (2-D P-I) system relative to the pair of transitive 
abelian permutation groups and G 2 . lo state this more 
concretely in terms of matrices, it is convenient to assume 
throughout that the same symbol denotes the permutation as well 
as the permutation matrix representing it. More specifically, 
if p is a permutation for the rows then p also denotes the 
m X m matrix that results from permuting by p the ro'ws of the 
identity matrix of size m. Similarly, if q is a permutation 
for the columns, then q also denotes the n x n matrix that 
results from permuting by q the columns of the identity 
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matrix of size n. Thus, the result of applying peG-^, and q,sG2 

to xeT, is to give the permuted version of x which is concre- 

T 

tely described by the matrix pxq. , A formal definition of 
2-D P-I systems is then as follows i 

Def inition_2, 2, Let T be a 2~L finite discrete linear 
system on V. Let of order m and G2 of order n be transitive 
abelian groups of permutation matrices of sizes m and n res- 
pectively. If for every xeV, every keZ^ and every 

qieG2, 

T(pj^x) = Pj^(Tx)^ (2,2.1) 

and 

T(xci^) = (Tx)q^ ^ (2.2.2) 

then^ T is said to be a 2-D P-I system relative to G^ and G2. 
Further, the set of all such systems satisfying (2.2,1) and 
(2.2,2) is said to constitute a class of 2-D P-I systems rela- 
tive to G^ and G2. If G^ and G2 are the same group G, then 
we simply speak of permutation-invariance relative to G, 

Consider T, a 2-D P-I system on V relative to G^ and 
G2 Let 

P]j-X = X f xeV, • . 

Then from eq.uation (2,2.2), for any q^eG2, 
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T(xq^) = (Tx)li = 

But, from equation (2.2*1), 

T(pj^x) = Pjj.(Tx). 

Therefore, 

T(pj^xq^) = T(xq^) = (T(pj^x))q^ = (pjj.(Tx))q^ 

= * 

Thus , if ' 

Tx = y (2.2.3) 

then, 

T(pj^xq^) = Pj^(Tx)q^ = Pjj.yq^ • (2.2.4) 

Equations (2.2.3) and (2.2.4) more compactly express the fact 
that the effect of permuting the rows of the input signal of 
a 2-D P-I system by members of G-^ and its colmns by members 
of ^2 is is permute the rows and columns of the output signal 
exactly in the same manner. 

Before proceeding with the study of 2-D P-I systems, 
we need to examine in detail, how a signal xeV gets altered 
when we permute its rows by members of and columns by 
members of G 2 . This is done in the following section. 
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2,3 Mathem atical . Ins cri ption of th e Eff ect ol. 
a 2-1 Signal 

let Pjj; > belong to G, a transitive abelian group 

of permutation matrices of order m. From the way the members 
of such a group are ordered (Appendix A) it is known that the 
effect of premultiplying a signal xeV by is that the zeroth 
row of X gets shifted to the k-th row position. But how 
exactly the other rows get affected is not immediately clear. 

To clarify this let us first consider just an m- tuple of reals, 
V = (Vq, ’'^ 1 ,““"*, Then it is Imown (Appendix A) that 

= y0k’ '"iGk’ ■^20 k’ k’’; 

(2,3.1) 

i, e., the j-th element of is given by 

(Pk(v))j = ^j0k ^ ic, jeZj^,p^eG ^ (2.3.2) 

where- denotes pointwise subtraction operation (Appendix A) 
in a mixed-radix number system with radices , m^, m 2 , — - , 
m^__^ which are the invariants of the group G, 

A 2-1 finite discrete signal xeV is double indexed and 
of the form x. .,i£Z , jeZ . When the rows and colimins of x 

X j j lu n 

are being permuted independently by members of transitive 
abelian permutation groups G^ and G 2 respectively, equation 
(2,3.2) can be directly applied independently to each one of 
the indices of the signal. 
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^0,1 

^0,n-l 

1 

let 

X _ ' 

♦ 

^1,1 

^l,n-l !• 

* 1 

• A' 


i • 

i 

; ni-1,0 



X T T - - - - 

m-1,1 

^m-l,n-l : 


pa0i,o 

Qi,l - - ” 

^0 @i,n-l 

Then, 

p.(x)=j 

! • 

"iQi,! - - - 
• 

» 

^1 Qi,n-1 

« 

* 

• 


: ^m-l(l>i,0 
i 

^m-1 v^i, 1 

\i-l (^i,n- 


Thus, the (fcrl)-th eleraent of p^(x) is given hy 


(Pi(x))j^_l = I p^eOj_,leZj^ . (2.3.3) 

V 

Also, 


- ^k,H3 


( 2 . 3 . 4 ) 


wher^ denotes pointwise subtraction operation in a mixed- 
radix number system with mixed m^, m^^, m2 - - , m^_^ which 
are the invariants of the group G-^, and Q denotes pointwise 
subtraction operation in the mixed-radix number system with 
mixed radices n^, n^, 1 which are the invariants 

of the group ^2. 
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Combining (2,3.3) and (2.3.4) we have, 


.T 


(Pi ^ ij’k.i = ^k©i, iQ3 


(2.3.5) 


Equation (2,3.5) shows the precise way in which each element 
of the signal x is affected when its rows are permuted by 
members of and the columns are permuted by members of 02* 

To be specific, it states that the k,l-th element of the 
signal obtained after permuting the rows and columns ~ rows 
by the i-th member of and columns by the j-th member of G2, 

is the (k.'0 i, 1 Q j )-th element of the original signal x. 

In the particular case when both G^ and G2 are cyclic, 
equation (2,3.5) becomes 


(p. X q;^). 


3^k,l ^(k-i)_ (1-3) 


( 2 ^ 3 . 6 ) 


mr 


n ? 


where (a-b) denotes subtraction modulo c. 

To consolidate the above ideas, we shall now consider 
several examples. ¥e first illustrate the mixed- radix system 
to clarify how the row or column indices are changed as a 
result of applying the permutations. 


Example 2,3.1s Eor the mixed radices m, = 4 and m, = 2, the 

mixed-radix weights are w = 1, w, = 4 and Wp = 4 x 2 = 8. 

0 ^ 

Any number k in the range jS' to 7 can be expressed uniquely 
using these mixed radices in the form k = 

the positional notation k may then be written as < a^,a^ > . 
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Table 2.1; 


The. Mixe d-Radix D igits for K upibers 0, ..to, ,7, 
Rum her Mixed- R adix Di gi t s 


0 

1 

2 

3 

4 

5 

6 
7 


0 

0 

0 

0 

1 

1 

1 

1 


“O 

0 

1 

2 

3 

0 

1 

2 

3 


Pointwise subtraction of integers in the mixed-radix system 
that results from such a representation of numbers is carried 
out as follows J 


If i and j are two integers in the usual representa- 
tion with fixed radix = 10, then first find the mixed-radix 
representations for i and j. Let 

i “ ^ ^ ^0 ^ e^nd ^ ^ 1 ^ ^0 ^ * 

Then, 

=<(il ~ ^iG^ ^^0 "* ^*0^4^ / 

where the suffixes 4 and 2 are the values of the radices mQ 


and m^ respectively 


Thus, 


0 2 

= <(0-0)2, (0-2)^> = 

A 

0 

V 

II 

ro 


1(3 2' 

= <(0-0)2, {1.-2) > = 

<0,5>= 3 


2 ( 2 

= <(0-0)2, (2-2)^> = 

<0,0 >= 0 


3 02 

= <(0-0)2, (5-2)^> = 

<0,1 >= 1 


402 

= <(1-0)2, ^0-2)4> = 

<1,2 >= 6 


502 

= <(1-0)2, {1-2) > = 

<1,3 7 


032 

•= <(1-0)2, (2-2)^> = 

tl,0 >= .4 


702 

= <(1-0)2, (3-2)^> = 

<1,1 >= 5 

* 

Example 2.3»2 : 

Consider the signal x 




^0,1 ^0,2 

0,3 

0,'^! 


:^1,0 ^1,1 ^1,2 

0,3 

0,4| 


^2 0 ^2 IL ^2 2 

0,3 

0,4; 

X = 

«.x^,0 x^^^ x^^2 


j 

0,4] 


K,o ^4,1 0,2 

0,3 

0,4^ 


:^5,o ^5,1 ^5,2 

f 

5,3 

^5 , 4-' 


:Xr A , X 

; 6»0 6,1 6^2 

0,5 

0,4’ 


0,0 ^7,1 ^7,2 

0,3 

0,4! , 


let he the traxisitive abelian permutation group 
isomorphic to the abstract group with invariants 4 and 2 and 
let ^2 "tie transitive abelian permutation group isomorphic 
to the abstract cyclic group of order 5. For we have 
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m^= 2 and = 2 and eIq = ^ for (t 2 . ¥e will now determine 
T 

(P 2 X <1^)> i.e,, the signal obtained by permuting the rows 
of X by P 2 £G- 2 _ and the columns by q^eG- 2 . 


By using the results 

of the 

previous 

example , 

the per- 

signal may be written 

as 








— 

P 2 ,l 

^ 2,2 

^2 ^ ^ 

Xo ,1 

2,4 

^ 2,^1 

1^3,1 

^3,2 

^3,3 

3,4 

^3,ol 

|^d,i 

^ 0,2 

^0,3 

^0,4 

’ f . 0 - 

(P 2 ^‘ 14 )= ^ 

^ 1,2 

^1,3 

'' 1,4 

1> 0' 

9 


^6,2 

""6,3 

^ 6,4 

X/- 

6,0; 

K,i 

^7,2 

^7,3 

^7,4 

Xr, 

7,0' 

^i^4,l 

i 

^4,2 

^4,3 

^4,4 

^4,10< 


^5,2 

^5,3 

^5,4 

Xir 

5,0! 


2*4 Ghar act eri zat ipn . of _2~D I_. Systems .„lhe _ Unit 

Respon se Matrix 


As mentioned in section 2,1, a finite discrete linear 
2-D system T is completely characterized by its standard 
response matrices 



i T( A . ) 


ieZ , 


jeZ 


n 


V 


2-D P-I systems are finite discrete linear 2-D systems endowed 
with the special property of permutation invariance as defined 
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in section 2,2. ¥e shall now see how this property of permu- 
tation invariance permits a simplified characterization of 
these systems. Consider a 2-D P-I system T defined relative 
to and G2» ^or any p^ and q.,, 
we first observe that 


0,3 


A 

i»3 


and 


A 

i,0 



A 

i »3 f 


so that, 


‘i-»3 




= Pi '"0,0 4 


Then, since T is a 2 -D P-I system defined relative to and 
G2, we have 


T. 


. = T A . . = T(p. 

i» 3 1,3 ' ■‘^1 


0,0 


4,0 


= 



T 

0,0 



y 


Hence the standard response matrices T. . satisfy the rela- 

1,3 


tionship 


T 


■i,j - % ^0,0 *^3 


This is summarized in the following theoremi 


y 


TheoreEi.._ 2 », 4 »l« T be a 2 -D P-I system relative to G^ and 

G2. Then its standard response matrices are obtained from 
Tq q, the first of these matrices, by permuting its rows by 
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members of and its columns by members of G 2 ,i.e,, 


T. . 

X “ 


.1 


. = p. T q. . ; ieZ , jeZ , p.eG.,, q..EG^ 

1 0»0 0 m^ n’ ^2 2 


(2.4.1) 


Thus, a knowledge of T , which, is the system res- 

0 tO 

ponse to the unit sample signal A _ completely characte- 

0 fO 

rises the system T, 


In view of this result, T plays the same important 
role that the impulse response <4iae? in the case of time-inva- 
riant systems and so we give it a special status. 


Def inition 2.4.1: the first of the standard response 

matrices of a 2-D P-I system will be referred to as the unit 
response of the system. 

Theorem 2.4.1 suggests the existence of a very conve- 
nient output- input relationship for these systems in terms 
of the unit response matrix, say s, and the defining groups 
G^ and G 2 . This takes us to the generalized convolutional 
relationship which will be derived in what follows. 


2. 4, 1 T he Generalized Oonvolutional Rel atio nship f or 
_2- D P-I 

Let T be a 2 -D P-I system relative to G^ and G 2 . 
Using equations (2,3.5) and (2.4.1) we may write down the 
expression for the k,l-th element of the standard response ■ 
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matrix T. . of T as 


where as stated earlier , denotes pointwise subtraction 
operation in the mixed-radix system of representation of 

m„ ^ that are the 
invariants of G-^, and [3 denotes a similar operation but with 


numbers with mixed radices m^, mT , - -- - t 

o 1 r— 1 


the difference that in this case the mixed radices are n^, 
- - - » ^s-1 invariants of group G- 2 » 

Let xeV be any arbitrary 2-D signal. Then 


m-1 n-1 

y = Tx = T I I X.. 


1=0 0=0 




m-1 n-1 

I I 1 T(A ) 

i=o 0=0 


m-1 n-1 

^ ^ ^i 0 1 • 

i=o 0=0 


Using equation (2,4.2) we next get 

m-1 n-1 

" ik jio 3 "'i.J 


Here, Sj^ (k:,l)-th entry of the unit response 

matrix s of the system T. This equation will be called 
the generalized convolutional relationship that relates the 
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output and input for the class of 2-D P-I systems defined 
relative to G-^ and G 2 * 


Thepr^em 2. 4. 2 ; A 2-D P-I system T relative to and G 2 is 
characterized hy the generalized convolutional relationship 


y 


m-1 n-1 

ilo j=o * 




(2.4.3) 


where x,y^ and s are respectively the input, output and 

system's unit response arrays ; (^) and (^respectively denote 

pointwise subtraction operation in two mixed-radix number 

systems, one with 'radices m^, m^, - 

invariants of G-, and the other with radices n^, Ut , 

1 . o' 1^ 


-,,m T that are the 
' r-1 


^s-1 invariants of G 2 * 


2 • 5 The Vector ._S pa c^ . of „ a Clas s of 2-D ,5:; I__Sy,s_t ems 

^Yevf&ns 

It was shown in the ia&t section that each class of 
2-D P-I systems has a convolutional characterization given 
by ( 2 , 4 , 3 ). In this section we shall show that each class 
of 2-D P-I systems forms a vector space. We will then 
determine the dimension of this vector space and choose an 
appropriate basis for it. 
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Let S denote the class of 2-D P-I systems defined 
relative to G-^ and 0-2. Then for ^ ^1^^2^ ^^^n' 

and T, ReS, 

(T + R)(pj^x) = T(pj^x) + R(pjj.x) . 

But since T , ReS, 

T(pj^x) = Pj^(Tx) and H(Pij.x) = Pj^(Rx) • 

Therefore, 

(T + R)(pj^x) = T(pj^x) + R(pj^x) = Pjj-Clx) + Pj^(Rx) 

= P1j.((T + R)x). 

Also, 

(T + R)(xq^) = T(xq^) + R(xq^) = (Tx)q.^ + (Rx)q.^ 

= (Tx + Rx)q.^ = ((T + R)x)q.^* 

Thus, if T , ReS then 

(T + R)(p^x) = Pjj.((T + R)x)^ 

and 

(T 4- R)(xq^) = ((T + R)x)q^ , 

Therefore, 


(T + R)eS , 
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Further, for any scalar a belonging to tho real line, 

aT(p^^x) = a(pj^(Tx)) = apj^(Tx) = Pj^a(Tx) = pj^(aTx) « 

Als 0 , 

aT(xq^) = a((Tx)q^) = (aTx)q^ ^ 
i.e,, aTsS 

Closed under addition and scalar multiplication's is thus a 
vector space. 

Th eor em 2,5.1 ; A class of 2-D P-I systems, i.e., the set of 
all 2-D P-I systems relative to a pair of groups G- 2 _ ®2’ 

forms a vector space over R, the real field. 

The members of a class, say S, are also closed under 
composition, which may be treated as tRe binary operation of 
multiplication over the set S, Specifically, 

RT(pj^x) = R(pj^(Tx)) = Pj^(R(Tx)) = Pj^(RT(x))* 

Also, 

RT(xq^) = R((Tx)qJ) = (li(Tx)q^) = (RT(x)q^). 

Therefore, if R,TeS, then RTeS, 

This means that S can be treated as an algebra. 
However, for the present purposes we shall treat it just as 
a vector space, occasionally making use of its multiplicative 
closure to facilitate analysis. 
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2,5.1 A Basis for 3 

Now, to determine the dimension of S treated as a 
vector space and also to choose a suitable basis for it, let 
s be the unit response matrix of a 2-D P-I system T belonging 
to the class S. Then using the generalized convolutional 
relationship, the k,l-th element of the output may be 
written as 

m~l n-1 


where i k,l-th entry in the imit sample response 

s of the system T, 

Putting k^ U = p and 1 f-l .1 = q. ^ 


m-1 n-1 


Therefore, 


m-1 

n-1 


I 

k?=0 

I 

1=0 

^k,l ^ k,; 

m-1 

n-1 


I 

I 

b=0 

1=0 

■ p=0 q=0 

m-1 

n-1 

r%-i 

i 

I 

s ' ^ 

p=0 

q=0 

^ J k=0 
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But from equation ( 2 , 3 . 5 ) we have, 

^kQp.lQq.^ ^ ’■ ’■ 

Theref ore. 



m -1 

n -1 

m -1 n -1 

^q^k,l^ k,l 

y = Tx = 

I 

p=o 

^ ®p,q 

q=o 

P{ 

0 

1 1 

o 


m -1 

n -1 

(Pp X q^) . 


— 

I 

p=o 

Jo 


Def ining 

systems 

relation 

B. . X = 

p. X 

T 

q . for 

J 

x£V,Pj_e(rp,q^sG 2 

( 2 . 5 . 1 ) 

we may write. 

m -1 



( 2 . 5 . 2 ) 

y = Tx = 

( I 

i=o 

I 

0=0 » 

. B. .)x'. 

0 i» 0 

Therefore, 





m -1 

n -1 



( 2 . 5 . 3 ) 

T = I 

i=o 

I 

d=o 

9 j 3 

•• 

Thus, any system TeS 

may be written down as a 

linear combi- 




nation of the memhers of the set B. . 

i > J 


r 
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¥e shall now show that y linearly 

independent. 


Suppose, B. ieZ , jsZ , are not linearly indepen- 
1 ^ j in ii 

dent. Then there exists a set of coefficients a^^ 
jeZ^ not all zero, such that 

m-l n-1 

( y y a. . B. .) X = 0 for every xzY , 
i=o j=e ’ 


m-l n-1 m 

i.e. , I I a- . p. X q = 0 for every xeV » 
i=o j=o i »0 1 3 ; 


Since the above equation is true for every xsV, let us put 
X = Then we have, 


( 


pl-1 

L 

±=6 

Ya. . B. ,)x = 

1,0 1,3 

m-l 

V 

L . 

1=0 

n-1 

L 

3=0 

^i,3 

I^i 



m-l 

n-1 




= 

.1 

1=0 

I 

3=0 

®'i,0 

A . 

X 


T 

A 0,0 *^3 
0 

, = 0^ t 

f 0 


s/'' 



m-l 

n-1 



But 

I 

i=o 

C-J, 

II 

O 

^■1,0 

A . . = 0 implies that 

^ j 3 


a- 

1,0 

= P 

for 

every ieZ^ and every jeZ^. 


This contradicts our earlier assumption about the a. -’s 

J 

that not all of them are zero. Hence, B. ., ieZ , jeZ are 

X y 3 ^ ^ 
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linearly independent and according to (2,5*3) they span the 
space S. Thus, the operators or transformations B. 
jeZn defined by the formulae (2.5.1) constitute a basis set 
for the space S of the class of 2-D P-I systems defined 
relative to G-^ and G 2 * the dimension of the space S is 

m. n. Thus, the following theorem is fully established! 


Theorem 2.5.2; Let S be a class of P-I systems defined 

relative to order m and G 2 of order n, and whose input 

and output signals belong to V, the space of real m x n 

matrices. Then S is a vector space of dimension m.n over 

the real field. Further, the systems B- ., ieZ . 

If j m n 

defined by formulae (2.5.1) constitute a basis for S^i.e., 
they are linearly independent and any system TeS is expre- 
ssible as 


T = 


m-1 n-1 

j y s- . B. . 
1=0 j=o ^ ^ 


(2.5.4) 


where s • - are the entries of the unit response matrix, s, 

j ■ 

of the system T, 


/ 

/' 


2 . 5.2 Properties jif„.the_Basis,_Set^B. . 

........ ..... .. -X, Q 

• Elements of the basis set are closed under 
’multiplication', i.e., under composition. 
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Proof: Let B. . and B, ^ be ar.y two arbitrary members of the 
set B. ijkeZ j 3 ,leZ , and let x be an arbitrary signal. Then, 

ly j m li 

= PA ^ 4^ 4? = (pa)^(4j4i)’’' 

The permutations p. and p, are members of the group 0-, so that 


PiPjc = Pp?Pe2j^ and Ppet^^. 


Similarly 


Thus, 




= Ppy “iq = • 


Hence the set B. . is closed under multiplication. 

ly J 

Propert y PR2 : Elements of the basis set B. . are pairwise 

J 

commutative. 

Proof: .(p^U q^) = p. r qf q® 

Since p^ and p^^ are members of the abelian multiplicative 
group they commute. Similarly and q. also commute. 


Hence, 


ll = BkBl ^ ll 

= Pt(Pi k q®)q^ = 


i.e., ~ ®k,l ®i, every xeV. 
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Therefore, 

B. ..B, , = B, ,.B, . for every i,keZ and 

1,3 1l,1 ic, 1 i, 3 _^ ^ ' in 

every 0>le2^ ' 

Thus the elements of the basis set pair- 

wise commutative. 

An immediate consequence of the above properties of 
the systems B. . is that any two members of a class of 2-D 

j 

P-I systems commute. More formally. 


Theor em 2. 5.3* Bf B and R are two 2-D P-I systems of the 
same class, then TRx = RTx for every 2-D signal xeY, 

Proof: Prom (2,5.3) we may write 



where r is the unit response matrix of R. Let x be any 
arbitrary 2-D signal in V, Then, 
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TE(x) = ( I I s B I I r,. , B., , )x 

j__Q j_Q -‘-»J -L» J V— n T-f 


4. ^ 1 ■^Ir T ' 

15^0 1=0 


H O 

11 

Ys. . 

3=0 

k=0 

Y 

1=0 

^k,l 

B. . 
1,3 


m-1 

n-1 

m-1 

n-1 




=( 1 
i=0 

y s - . 

3=0 

I 

k=0 

I 

1=0 

''k,! 

\,1 

B. .lx 
1.3' 

m-1 

n^l 


m-1 

n-1 



=( 1 

k=0 

1=0 

®k,l 

xio 

3 I 0 

®i,3 

B.^px 


which completes the proof of this theorem. 


Now let us consider Y as an inner product space hy 
choosing a suitable inner product on it, For this choice 
consider the pointwise product, C, of two m x n matrices A 
and B, also sometimes called their Schur product, written as 
C = A oB, which is defined by the relation 


0. . = A. .,B. . t ieZ , 3^^ • 

1,3 i»3 i»3 m^ n 

With any appropriate norm si, for the space V, we then 
choose for the inner product on V, 

(x,y) = ’xoy|'i^ j x,yeY^ 

n It 

For definiteness, the norm used is Euclidean, 


• m-1 n-1 

^ ’ = ( ’I I 4 -i 

!i aj=0 3'=0 ^ 
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¥e now treat Y as an inner product space of dimension m.n 

and show that B. . is a normal operator [$0, p, 312 ]on it. ¥e 

m » j 

first note that 

(B. x) oy = (p X y = xo (p“^ yClT^)^) 

= Xo (p? y qJ = X oi-B^ _• y)^ 

J > J 

Thus, (B x) oy = x o (B* y) (2.5.5) 

? J -i- 9 J / 

Where B^ . is the system defined "by 

= p? X ; for every xsV . (2.5.6) 

Since (B^^^x,y) = || (Bj_^jx) oy||^, from equation (2.5.5) we 
have 


(Bi^ .x,y) = II (B.^ .X) oy|| ^ = Vxo (B* 


= (x, bJ .y) . 




Thus defined as in equation (2,5.6), is the adjoint of 

B. .. 

1.0 

-Further, we have 


B 


^.B* .x=p,(p^x,.),^=x=p^(p,x,p4j 


= B. . B. . X for every xeV. 

^ > J ^ 9 J 
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This shows that B. . commutes with its adjoint, i.e,, B. . 

j J 

is a normal operator on V for any andany Prom 

property PR2 we already know that the systems B. . are pair- 
wise commutative. Thus, 

Theorem 2.5.4 ° If S is a class of 2-D P-I systems then the 
pairwise coimnutative systems B. . defined by equation (2.5.1) 
which form a basis for S are normal operators on V, the 
signal space for S. 

That B. , are commutative normal operators on V is a 
J 

useful property in that, it allows us to directly make use of 

the spectral theory of normal operators [30, 5l] to arrive at 

the eigenvectors' of the systems B. . and the class S of 2-1) 

3 

P-I systems for which they serve as a basis. 

2.6 Eigen v alues and Eigenv ectors of 2-D P-I Systems 

In the 3.asf section we had seen that the systems B. . 
form a basis for the vector space S of a class of 2-D P-I 
systems. Further, by virtue of property PR3, they are a set 
of commutative normal operators on V, the space of real m x n 
matrices. 

But then, it is known [50,31] that the members of a 
set of normal operators on a finite- dimensional inner^product 
space T have in common a set of orthonormal eigenvectors iff 
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the operators are pairwise commutati've. It has already heen 
shown that the systems B. . are pairwise commutative normal 

J 

operators on the inner product space V, Hence, the set of 
basis systems B^ have a common set of m, n 

orthonormal eigenvectors that span the space V. Since any 
member of S can be expressed as a linear combination of the 
systems B. it then follows that all the members of S, a 

j 

class of 2-D P-I systems on V, have a common set of ortho- 
normal eigenvectors that span the space V. Thus, we have 
fully established the following theorem; 

Theorem 2.6. 1; All members of S, a class of P-I systems 
defined on ’V, the space of real m x n matrices, have a common 
set of m.n orthonormal eigenvectors that span the space Y, 

We now proceed to determine these eigenvectors. For 
this purpose, however, it would be more expedient to esta- 
blish a relationship between the eigenvectors of the class S 
of 2-D P-I systems relative to groups and G 2 on the one 
hand, and those of the classes of 1-D P-I systems and S 2 
on the other, where, is the class of 1-D P-I system rela- 
tive to and S 2 , the class relative to G 2 . Before procee- 
ding with this task, we would like to make the following 
remark: 

Remark 2. 6.1; Since the real number field is not algebrai- 
cally closed, for the purpose of dealing with the eigenvalues 
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and eigenvectors of 2-D P-I systems i<fe shall take the signal 
space to he ¥, the space of complex m x n matrices ra|fther 
than V, the space of real m x n matrices. 

let he a class of 1-D P-I systems relative to 

c ) 

Then it is known that (Appendix A)^Pjj^£G-^, basis for 

the vector space formed hy and that all the members of the 
class have a common set of orthonormal eigenvectors. These 
eigenvectors given hy span the space- of complex 

m- tuples. 

Further, let S 2 he a class of 1-D P-I systems relative 
to Gr 2 * Then q.jSG- 2 » P^o'^ide a basis for the vector space 

formed by S 2 and all members of S 2 have a common set of ortho- 

normal eigenvectors given by h^, jsZ^, which span C^. 

Now consider 3, the class of 2-D P-I systems on W rela- 
tive to ^2* referring to theorem 2.5.1, the sys- 
tems keZ^, IsZ^, defined by eqLiation 2,5.1, form a basis 

for 3, and all the members of 3 have a common set of orthonor- 
mal eigenvectors that span the space ¥. 

Now, to see tho relationship between the eigenvectors 
of 3 and those of 3^ and 32, let h^ be the i-th eigenvector 
of the systems belonging to 3^, and h^ be the j-th eigenvector 

of the systems belonging to S 2 . Then, it is known (Appendix 

A) that the k-th entry, keZ^, of h^ hs given by 

= n y/ “ ; k. dez (2.6.1) 

^ a=0 ^ * 
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where and cceZ^ are the mixed-radix digits in the 

expansion of k and 3 respectively with respect to the mixed 
radices m , aeZ which are the invariants of 0 - 2 , and Yrv, is the 
m -th root- of looity given hy 

Yjn = exp(V-l 1^), aeZ ^ (2.6.2) 

a a 


Further, 




m m m m 




and 


^1 K = ^n K = K J ^l"^2 ^ 


(2.6.3) 

(2.6.4) 


where is "ttie i-th eigenvalue of the matrix Pjj-SG-^, the 

eigenvector associated with this eigenvalue being h^ and 

is the 3 ‘-th eigenvalue of the nmtrix q. 2 _eG- 2 , the eigenvector 

associated with this eigenvalue being h^. Further, h^’^ is 

n ^ in 

the complex conjugate of h^^^ defined as in equation ( 2 . 6 . 1 ), 
ITow define h^’^ as 


'"N ^ (2.6.5) 

If 2-D P-I systems ksZ^, leZ^ defined as in equation 

(2.5.1) are considered, then 




'k,l ""N 




k 

f n 

1 -"n 


Iq = Pv hi (hi) 


T T 

'k ""m ^""n^ "^1 


(q, hi)^ = 


m 


n 


(hb* 


n' 


i,k 3,1 ,i ,3 

% * ‘^n * ^ 
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i. e 


7 





/-rd » 4. ■v i 7 3 

n ' 


( 2 . 6 . 6 ) 


Thus, ^ equation 2,6. 5> are the 

eigenvectors of the basic 2-D P-I systems B, ^ , k£Z_, leZ_ of 

^ k,l' m’ n 

the class S. Since any system TeS is a linear combination of 
the basic systems ^ of that class, it follows that all 
members of S have a common set of orthonormal eigenvectors 


^^^n* 

Specifically, if TeS is 

given by (equation 

2.5.3) 



m-1 

n-1 


T = I 
lc=0 

1=0 k, 1 k, 1 ^ 

(2.6.7) 


X’;-here Sj^ entries of the unit response 

matrix s of T, Then referring to equation (2,6,6), 


m-1 

n-1 



4’^ 


o 

11 

I 

1=0 

^k,l 

k,l 


m-1 

n-1 





= ( I 

k=0 

I 

1=0 

®k,l 

i, k 

a » 

m 

• 


for every every d^Z^- (2.6.8) 


Thus, the (i,j)-th eigenvector h^’ ^ of a 2-D P-I system T 
belonging to S is associated with the (i,j)-th eigenvalue 
given by 




m-1 n-1 

L J 


S, 


b =0 1=0 “ 




n 


isZ^, OeZ. 


n ^ 

(2.6.9) 
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where cr^’ and are as defined in equations (2,6.3) and 

(2,6,4) respectively. We now summarize these results in the 
following theoremj 

Theo rem 2.6,2 ; Let S he a class of 2-D P-I systems relative 
to order rn and ^2 of order n, let and S 2 he classes 

of 1-D P~I systems relative to G-^ and G 2 nespectively. Then 
the (i,j)-th eigenvector h^^^ of S is given hy 






3 £2, 


n 


f 


where h^ and h^ are respectively the i-th eigenvector of 
and the j-th eigenvector of S 2 » Further, if any TeS has a 
unit response matrix s, then the eigenvector ^ of T is 
associated with the eigenvalue ^ given hy 


_ 

^T 


m-1 

I 


k=0 


n-1 

1=0 




isZ , 

m' 


jeZ. 


n ? 


i k 

where is the i-th eigenvalue of the k~th permutation 

matrix and is the j-th eigenvalue of the 1-th 

permutation matrix qj^eG 2 « 



CHAPTER 3 

EQUIVALENT 1-D SYSTEMS FOR 2-D P-I 
SYSTEMS 

In Chapter 2, we defined a 2-D permutation- invariant 
system as a 2-L finite discrete linear system which exhibits 
invariance to permutations of the rows and columns of its in- 
put signal, where the permutations applied to the rows and 
columns separately form transitive abelian groups. In the 
present chapter, we establish an equivalence between members 
of a given class of 2-D P-I systems and those of a 'correspon- 
ding class ' of 1-D P-I systems. This is done in the following 
three stages: In section 1, we deal mth the problem of re- 
presenting a given 2-D signal as an equivalent 1-D signal. 

This problem is viewed as one of establishing an isomorphism 
between V, the space of all real m x n matrices, and R^, the 
space of all real N- tuples, N = m,n, through convenient linear 
transformations from V to R^, which may be described in terms 
of suitable index mappings f : x -+• Z 


¥e then show 
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in section 2 that permuting the rows and columns of XeV hy 

members of G-^ and G -2 respectively is eq.uivalent to permuting 

the equivalent 1-D signal xsR by the 'corresponding members' 

of another transitive abelian group G- of permutation matrices, 

which is shown to be isomorphic to the direct product group 

G-^ X ^ 2 * finally, in section 3» starting from a 2-D P-I 

system T on V defined relative to G-^ and G 2 » show that the 

IT 

equivalent 1-D finite discrete linear system t on E. , obtained 
through a linea,r transformation Q from V to is indeed a 

permutation- invariant system relative to G. 

The fact that a 2-D P-I system has associated with it 
an equivalent 1-D P-I system, gives rise to several intere- 
sting possibilities in the processing of 2-D data by 1-D 
techniques. The design of stable 2-D linear shift- invariant 
systems and digital filters is beset with problems of spe- 
ctral factorization [8-12] that are not encountered in the 1-D 
case. Efforts to overcome these problems have led to elegint 
but some what cumbersome methods of 2-D factorization such as 
[ll, 12]- There have also been attempts to use 1-D techniques 
for 2-D tasks. McClellan [6] has proposed an algorithm 
which enables one to approximate many useful 2-D functions by 
converting an appropriate 1-D linear phase design into a 
linear phase 2-D design. In another approach [s] the unit 
sample response of a 1-D FIR filter designed to give the 1-D 
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ideal function which is obtained by appropriately slicing 
the given ideal 2-D function, is back- pro j ected to give a 
2-D unit sample response that was 'expected* to approximate 
the given 2-D ideal function. All these different methods 
are, however, limited in their efficacy by the fact [l5] 
that an exact 1-D implementation of a 2-D linear shift- inva- 
riant filter does not possess the shift- invariance property. 

In contrast, as the results of this chapter show, a 2-D P-I 
filter or system which has the same role for finite discrete 
signals that the digital filters have for infinite sequences, 
has a 1-D implementation which is again permutation- invariant. 
In particular, if the original 2-D P-I system is of the 
cyclic kind, then with only a minor constraint on the frame 
size which does not in any way reduce its utility, one can 
design a 1-D cyclic P-I filter to perform the 2-D tasks, 
after an appropriate translation of the 2-D filter perfor- 
mance requirements into equivalent requirements on the 1-D 
filter (Chapter 6). 

3 . 1 Re pres ent ing 2-D Sig nals by 1-D Sign als 

As mentioned earlier, we will in this section seek 

some convenient methods of representing a 2-D finite discrete 
(P 

signal asj^f inite 1-D sequence. 
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The signal space for 2-D P-I systems is the vector 
space V of real matrices also called 2-D arrays or sequences 
of size m X n, where m and n are arbitrary positive integers; 
the dimension of V is W = m.n. Matrices Aj|_ y 
each of size m x n, form the standard basis for 7, An arbi- 
trary 2-D signal XeY may then be written as 


1 ^ 0 , 0 ' 

♦ ► 


f m-1, 0 


■Xn T ' 
D,n-1 , 


X 


[ T X.?. .eR.ieZ ,jeZ - 

m-l,n-l ' 2 m' n 


(3.1.1) 


A ‘corresponding’ 1-D finite discrete signal x on the 
other hand, is a single- indexed sequence of length U = m.n. 

The pertinent signal space for these is R^, the space of all 
real N- tuples. 

Clearly, a simple way of converting signals in 7 into 
corresponding or equivalent signals in R^, is by defining a 
convenient linear transformation Q from 7 to R^ which simply 
rearranges the elements of a 2-D signal Xe7 into a 1-D se- 
quence X of length N^i.e., 

Q ; 7 -V R^, X = Q(X) . 

This transformation Q may be defined in terms of its e.ff ect 
on .'s, the basis elements of 7, by a mapping of the form, 
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QC = 


'k 


ieZ , 
m 




keZ 


'N 


( 3 . 1 . 2 ) 


where e^^ is a column vector pf length N with a 1 in the k-th 
position and zeros everywhere else, i. e. , e^^ is the k-th 
member of the standard ordered basis set e^, 

Thus, under a transformation Q as defined by equation (3.1.2), 
a 2-D signal XsV will be transformed into a 1-D sequence xeR^, 
with the (i,j)-th element of X occupying the k-th position : 
in X, 


It is clear that a transformation of the type given by 
eqiiation (3.1.2) may equivalently be described by a one-to- 
one index mapping f, 


f 


Z X Z 
m n 


i.e,, in (3.1.2), 


Zjj, R = m.n ^ 


f(i,d) = k } 

} 

and f~^(k) = (i,j) ^ 


(3.1.3) 


Remark 3. 1.1 ? The 1-D representation of X obtained through 
a transformation Q characterized by a mapping of the form 
(3.1.2) is a representation of X in terms of its coordinates 
relative to the basis matrices a- ., when these are ordered 
according to the corresponding index mapping f of the form 
(3.1*3). We shall hereafter refer to f as the index mapping 
associated with the transformation Q, 
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Remark If x is a l-R signal given by 

X = Q5I 

where Q is a transformation of the form (3*1»2) and X is a 
2-D signal, then x will be referred to as the l-R equivalent 
of X, 

A familiar example of an index mapping of the form 
(3-l«3) is provided by what is generally called the ’lexico- 
graphic ordering’ of pairs of indices. Example 3.1.1 illu- 
strates the use of this mapping for obtaining 1-D equivalent 
of a 2-D signal. 


E,:^mple m=2, n=3, R = 2x3=6, Let the basis 
elements of V, viz.^ ^ ieZp, jeZ- be ordered lexicogra- 
phically, i. e, , according to the following index mapping f 


k= f(i,j) = ni + 0 = 3i+ ieZ^, 


rx 


X 


X, 


let 


X = 


0,0 ^" 0,1 ^" 0,2 


^ 1,0 ^ 1,1 ^ 1,2 


Then the resulting 1-D representation of X is the vector xeR 
gl-ven by it = 


A less familiar but, nevertheless a very useful type 
of index mapping when m and n are relatively prime, is pro- 
vided by 
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k = = (k^i + ^ 23 ) mod F ; ieZ^,j£Z^,F 

= m.n, keZjj. ^ 

where., k^^ and ^2 appropriate integral multiples of n and 
m respectively. This mapping [52] has the interesting 
property of being cyclic with respect to all the three 
indices i,j and. k, when k^ and k^ are properly chosen, ¥e 
shall discuss this in detail in Chapter 6, For the present 
vre consider the following example to illustrate its use for 
obtaining 1-D equivalent of a 2-D signal: 

Sample 3, 1 , 2 ; m = 3^ n = 5. Iiet a . ieZ^, jeZc- be 
ordehed according to the mapping k = f (i,j) = (lOi + 63 ) mod 
15 } jeZ^j keZ^^, 



The way the entries of the 2-D signal X are to be 
rearranged starting with Xq q, in order to obtain the equiva- 
lent 1-D signal x, is indicated by the arrow-heads drawn in 
the array X. 

15 

Thus, the 1-D representation of X is given by xeR , 


where 
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X = (X 
Z 


o 

o 

^ 1,1 

XT 

^2,2 


h ,4 

"^ 2,0 

0,4 

O 

H 

^ 2,1 

X 

o 

ro 


"^ 2,4 


.1 


X, ^ X, 


Note that the linear transformation Q from V to corres- 
ponding to this index mapping transforms the basis matrices 

A. . ieZ . jeZ , of Y in the following manner*. 

X y j in n 


o 

Q 

< 

®0 

^ 1,2 

®7 


®1 

^ 2,3 

®8 


®2 

^ 0,4 

®9 



^ 1,0 

®10 

^ 1,4 

"4 ■ 

^ 2,1 

®11 

^ 2,0 

®5 

^ 0,2 

®12 

^ 0,1 


^ 1,3 

®13 



^ 2,4 

®14 


15 

where, e^^, is the standard ordered basis set of R . 

Recall that the 2-D unit sample sequence is ^ q q* 
an m X n matrix with a 1 in the (0,0)-th position and zeros 
everywhere else. Further, the l-R 'unit sample sequence is 
Sq, the column vector with a 1 in the zeroth position and 
zeros everywhere else. In view of this, we make the following 




i- !. i . I . 


remark: 
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Remark ^.1^: Hthough any one-to-one index mapping would 
serve the purpose, we shall utili xo only those that map (0,0) 
to 0, since these mappings will cause the 2-D unit sample 
signal Aq q» to go into the 1-D unit sample sequence Cq. 
Incidentally, such mappings permit us to label members of 
the direct product group x G 2 (remark 3*2.1) using the 
method adopted earlier in Chapter 2 * 


3 • 2 E quivalent P erm uta t ion. on 1 -D Signals 

Having examined the question of representing any arbi- 
trary 2-D signal XeV as a 1-D signal xsR^, logically the next 
step in our attempt to seek an equivalent 1-D system for any 
given 2-D P-I system would be to examine, what corresponding 
permutation the 1-D signal x undergoes, when the 2-D signal 
X has its rows and columns permuted by certain permutation 
matrices p^ and q^ respectively. To be more specific, con- 
sider the diagram of Eig. 3.1. 




V 


t 

i 

i 

V 


Q 


Q 




R- 


4 . P 


R^ 


Pig. 3 . 1 2 Equivalent Permutation on 1-D Signals. 
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i, X "be an arbitrary 2-D signal, 

ii, X be the 1-D representation of X under the linear 
transformation Q i.e,, x = -iX, 

iii. Pjj. tf© an m X n permutation matrix acting on the rows 
of X and q.^ an n x n permutation matrix acting on the 
columns of X, 

T 

iv» Xp = p^Xq^, be the signal obtained after permuting 
the rows and columns of X, and 

be the matrix representation of the equivalent 
permutation on x such that if ^ then X^ = Q x^. 


Now, the questions that arise are (a) what is the form 
of ? (b) if Pjj.sG- 2 . 12.^ ^2 ^2 transitive 

abelian groups of permutation matrices of orders m and n res- 
pectively, will the set corresponding permutation 

matrices acting on x, constitute a transitive abelian group 
G- ? (c) if the set P^ constitutes a transitive abelian 

group G- of permutation matrices, how is the group G- related 
to the groups and ^2 ? 

Now since, 


X 


X = 

P 


m-1 n-1 

T y x . . 'A . . 
iio j£o ^x,3 


m-1 n-1 


Q(Plj.2:(li) = Q(Pjj.( I’ X X A. Jly) 
-L K - ■ p. 1,3 1,3 1 


i=0 3=0 
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= (P),© 6 j) 

= (Pi,@^ Ij,) Q 6 *) 

= (Pt.®„ <li) Q (. t, ,) 


Q 


1 » J / 


i.e. , Q(Pv^t ^q.?) = (Pv® <1 t) Q ( A. J 

Q -J- 


i, '^1' 


Using this in equation 3 # 2 , 1 ^ 




in*^l n"^IL fp 


m-l n-1 

I I (Pk<S 'll) ^ i)\ 

i=0 0=0 I* 


m-l n-1 

(Pv© li) « c -I I i \ ,■) 

^ Q -i-^n -i-n 


i.=0 j=0 


(Pk ® 'll) Q (^) • 
Q 


m 

Since x == Q(p, X q, ), vre have, 


ac 


Q(pj^ S q^) = (p,^@ qj^) Q (X) - 

Q 


(5.2.4) 


Equation (3.2.4) implies that, the permutation of rows of the 
2-D signal X by Pj^ and columns by q^ is equivalent to the 
permutation of the 1-D representation x, of X by the E x N 


permutation matrix (pj^(^ qj_). 
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The following examples illustrate these ideas: 
Exa mple 2 ^1 : 



; Y 

1 ^0,0 

O 

H 

^0,2 • 


X = 

i 

i 1,0 

h.i 

5 

^1,2 ; 

i- m = 2, n = 3 

Therefore, 

F = m.n = 

2.3 = 

6. let 

the index mapping f as so- 


dated with Q bo given by 

k = f(i, 3 ) = 31 + U 0^2^ and keZj^ ' 


This mapping corresponds to the lexicographic ordering 
of pairs of indices. 


. 0 1 - 


Let the rows of X be permuted by the matrix p^ = ' ^ 

IT) 1 0) ^ 


and the columns by d = iO 0 1' 

!l 0 oi 


= P-, X q. 


T 


_ — _ 0 
0 1( ^ * 

1 oj 


X 


0,1 ^0,2* 


1,0 ^ 1,1 "" 1,2 I 


0 0 1 ^ 
10 0 = 
0 1 0 r 


Therefore, 


Q(Xp) 


ih.l h,2 

^ 0,1 ^ 0,2 


x^ = (X 


X 


X, 


Y ^ 

1/0 i 


X 


0,0 : . 


X, 


X, 


X. 


1,1 "" 1,2 n ,0 ^" 0,1 ^" 0,2 ^" 0,0 




Also, 
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fo ii 

‘1 Q 



[i 


0 10, 
0 0 1 ; 
II 0 0 { 


Therefore, 


;0 0 0 0 1 0 I 
• 0 0 0 0 0 1 ; 

10 0 0 1 0 0 ! 

|0 1 0 0 0 0 i 

(0 0 1 0 0 0 ^ ' 

11 0 0 0 0 0 t 


Q 


0 

0 

0 

0 

1 

0 ? 

0 

0 

0 

0 

0 

1 J 

Io 

0 

0 

1 

0 

0 J 

! 0 

1 

0 

0 

0 

0 ^ 

io 

0 

1 

0 

0 

0 ' 

i 1 

0 

0 

0 

0 

OJ 

^^1,1 ^1, 

,2 

^1, 




|o,o 
^0,1 
to, 2 
Jl,0 
1,1 
1,2 


^0,1 ^0,2 



T 



Example 2, 2 : Consider the same 2-D signal as in the pre- 
vious example, hut let the index mapping associated with Q he 


k = f (i,j) = (5i + 4d) “od 6, ieZ2, keZg . 


The mapping f is given in a tabular form in Table 

Ta bl e ,3»1« Mapping of Indices in Example. 5»2.2 

(i»d) k 

0,0 0 

1,1 1 

0,2 2 

1,0 5 

0,1 4 

1,2 5 


3 . 1 . 
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Lelj t/h.© rows and columns of 1 be permuted by tbe same 
matrices as in the example 3,2.1. 

Xp = X "'- 1,0 f 

I Y Y TT - ' 

I 0,1 ^ 0,2 ■'" 0 , 0 ,'. 

Therefore, 


Q(X^) 





^ 0,2 ^ 1,0 ^ 0,1 ^ 1,2 


^0,0 



While writing down the matrix form of p-, (£’ q-, we note that 

the k-th column of I2 obtained by taking p^^ q2j 

Q y 

where is the i-th column of p^ and q2j is the j-th column 

of q2, Values of k corresponding to the particular values of 

i and 3, ieZ2 and jeZ^, are obtained by using the index 

mapping f. Again, for writing down the elements of the k-th 

column of proper order, we follow the index 

mapping, i.e., if a 1 occurs in the p-th place of p -, and 

the q-th place of q2^ then a 1 occurs in the r-th place of 

the k-th column of Pn <l2» 'tbe reZg corresponding to 

Q 

(p,q) is obtained by using the index mapping. 


Thus, 


Pi ^2 


- 0 1 0 0 0 0 ; 
.0 0 1 0 0 0 ! 
I 0 0 0 1 0 0 ^ 
0 0 0 0 1 0 = 
*000001; 

IjL 0 0 0 0 Oj 
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(Pl ® 9.2) ^ (x) 
Q 


iOlOOOO- 
. 0 0 1 0 0 Oi 

* 000100 “ 
; 0 0 0 0 1 0 
* 0 0 0 0 0 1 * 
1 0 0 0 0 0 I 


to, 2 ! 

|l,0 i 

vO,l • 
^1,2 * 


,T 


^\,1 ^ 0,2 ^ 1,0 ^ 0,1 ^ 1,2 ^ 0 , 0 ^^ “ *^^^1 ^ /^ 2 ^ 


Proceeding further, let the matrices Pj^ and q,^ which 
permute respectively the rows and columns of the 2-P signal 
X, be members of transitive abelian groups of permutation 
matrices of degree and order m and G 2 of degree and 

order n, rospectively. Then, we obtain a set M of N permu- 
tation matrices, 

^ 9.3_} , Pk^^l» ^ ^^^n 

every member of which satisfies equation 5 * 2 . 4 . We shall now 
show that this set M forms a transitive abelian group G of 
order N = m.n. ¥e do this in three steps. 

(a) i. Let (Pj_@ q^ ) and (Pj^.® q]_) Le any two arbitrary 
members o^^ the set M, whSre 

Pi, Pk^^l an^ qj,93_eG2. 

Using standard properties of lironecker products 
(Appendix B), 
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wliGro UiG Gymbol . represents the operation of taking 
the conventional product of matrices. Eut P^.Pjj. = P sG-^ 
for some peZ^ and = q(^eG 2 

(PiCi^ aj).(Pi,(j|k q^) = (pp(x'^ q^)eM. 

Thus, the set M is closed under multiplication. 

ii. Now, let (Pi(?^ Gj-), (Pk® ajid (p^© q^) j,k,peZ^ 

aiid 3,1, qeZ^ hg three arbitrary members o? M, Then 
using properties of Kronecker products, we may write 

= (Pi.(Pl,. Pp))®^ (qj.(qi. qq)) • 

Since Pi>Pk»Pp®G^ and q.j , qq^eG2» losing the associa- 
tivity properties of groups and G2, 





= ((Pi- pP-Pp)^ ((aj. qi).qp 
= ((Pi(i> qp.(Pj,(5oqi)).(Pp®^ qp- 


Members of the set M therefore have associative pro- 
perty under multiplication. 


iii. If Pq is the identity element of group and ^ is 

the identity element of group G2 ,(Pq(^ Iq) forms 

Q 
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the identitjr element in set M because for an arbi- 
trary element (p^(|) q.)eM -f ieZ^, the following 

relation always hol^* 


(PO@Q Ij) = (Pq. Pi®^ V 


Q 


Q 


iv. let (p^. (x) q^)eM t let 


n 


Pq and 


-Q ^ 
be the 


identity elements of the groups and G2 respectively. 
Then there exist unique elements P]j;SG-2_» keZ^ and q^eG2, 


leZ^ such that 



Thus, members of the set M form a multiplicative group 
G with conventional product of matrices forming the 
group operation. The identity element of this group 
is (pq(x) Gq) where Pq and Gq are the identity ele- 
ments of*^G^and G2 respectively. 

(b) ¥e now note that G^ and G2 are abelian groups. 

<lj).(Pj,lg^ <ll) = (Pi- Ij- li) 

= (Pk-Pi®3 V 

for every p^^, and. .every q^, q^eG ^2 * 

j, leZ^. Thus, group G is abelian. 
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(c) 


Since and Gg are transitive abelian permutation 
groups, the ordering scheme described in Chapter 2 
can be applied to their elements. Thus, p. , ieZ is 
that mcmbor of G^ which shifts the zeroth row of the 
2-D signal h to tho i— th row position when it premu- 
ItiplioG X, Henco, the matrix Pj_eG^ is identified by 
the fact that the zeroth column, of p^ has a 1 in the 
i-th place and zeros elsewhere. Similarly, q.. is that 
permutation matrix belonging to G 2 , whose transpose, 
on postmult iplying X, shifts the zeroth column of X 
into the j-th column position. Thus, the matrix q.jeG 2 
has a 1 in the j«th position of its zeroth column. 

Now, consider an arbitrary 1-D signal xeR^ : 



¥0 know that G is a transitive permutation group, if 
there exists for an arbitrarily specified integer reZ^^, 
H unique peimratati on matrix say which by acting 

on X shifts the element Xq into the r-th place. Since 
the index mapping f associated xvith the transformation 
Q is one-to-one, there is a unique ordered pair of 
integers (p,q.) corresponding to rsZ^ such that 

f^^Cr) - (p,q) I reZjj, peZ^, qeZ^. 


Then, from the way the matrix members of G are con- 
structed and the ordering scheme employed for members 
of G^ and G 2 , it follows that the permutation matrix 
q^) belonging to G is the element that 
shifts Xq ^into the 3>-thj^ position. 

Thus, it is seen that G is transitive and is of degree 
and order N = m.n. In all we have thus established 
the following theorem? 



S3 


^^f_2 . J. : Let Q:7 E.^ be a transformation 

which gives 1-D equivalents in of 2-D signals in 
7. Then permuting the rows and columns of a 2-D 
signal Xx7 by permutation matrices and q^. respe- 
ctively, is in effect the same as permuting the 
equivalent 1-D signal of X viz., xeR^ by the permu- 
tation matrix (p. (B q. ). If nsG, and q-eGr^, . 

1 Q J "X -i- J ^ 

ieZ^ and ^2 transitive abelian 

permutation groups of orders m and n respectively, 
then the set M S(Pi@ q^} forms a transitive abelian 
I'jroup ir of permutatioS matrices, vrbich is of degree 
and order H = m. n* 


Wo will Jiow extend the ordering scheme mentioned 

earlier, to the members of G, To do this, recall the way we 

construct the Kronocker product matrix using the index 

mapping f associated with Q. Consider an element = 

(p^(^ q . )eG ; We note that 

Q “ 

i. The zoroth column of P. . is the ICronecker product 

■ r , j 

of the zeroth columns of Pj_ and q^ respectively, 
(refer to remark 3.1.3). 


ii. The zeroth column of P^ ^ has a 1 in the k-th 

position if f maps (i,j) onto k, and has zeros every- 
where elSG. Also, because of the uniqueness of the 
mapping, there is no other member of G that has a 1 
in the k-th position of its zeroth column. 


X XX « 


Thus , P. . 
signal xeR 


iB that member of G which, on permutin^g 
shifts the zeroth element of x into the 


a 


k— th position. We shall therefore denote it by Pj^, 
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The element’ (p. (x) q..)e&, p. , icZ t Q.cQot 
1 -Q 0 '"=^ 11 ' m ^ 2* 

jeZ^, is denoted by if the mapping f associated with the 

transformation Q is such that it maps the pair of indices 

(i,j) onto keZjj, With this notation, I'jj.eG-, keZjj., is that 

member of G which shifts the zeroth entry of a signal 
, \T 

X = * • • » • * * ’^N-l' i^’to the k-th position. 

Having established that G= p . (x) q.., p. eG, , ieZ„ I 

X '-^Q j X X HI 

<ljeG 2 , 0 ^ 2 ^, is a transitive abelian group of permutation 
matrices, and is of order H = m.n, we shall now show that G 
is indeed isomorphic to the direct product of G^ and G 2 . 

For this purpose, let us define subsets H and K of G 


H = { Pj_ ® » where Pj_eG^ 

Q 

identity element of G 2 j 


f 


isZ_ and q.^ is the 
m u 

(5.2.5) 



identity element of G^^ . 


jeZn and Pq is the 

( 3 . 2 . 6 ) 


Using standard techniques in group theory [22, 26] we find that 
H and K are subgroups of G, Now, since G is an abelian group, 
every subgroup of it must be a normal subgroup [ 26 , p 6 L] There- 
fore, H and K defined as in equations (3.2.5) and (3.2.6) are 
normal subgroups of G, 


Then, we observe that 

P^eSi 

and every q. eG 2 . 
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Hence, it follows that G is the internal direct product of 
its normal subgroups H and K, i,e, , 

,V 

G H.K, (3.2.7) 

/ 

Let us now define a function 9 as follows : 

9(Pi(5^ ~ ^i every p^^eG^, 

Then 9 is a homomorphism from H into G^ because, 

<io)) 

“ j^i'^k every p^,pj^eG^, 

Purther, from the definition of 9 it is clear that it is one- 
to-one. Therefore, H is isomorphic to G^, Similarly, it may 
be shown that K is isomorphic to G 2 i.e,, 

H i G^ ^ (3.2.8) 

and 4 G 2 . ( 3 . 2,9) 

In equations ( 3 . 2 . 8 ) and (3.2,9) the symbol = is to be read 
as 'is isomorphic to'. 

Equation (3.2,7) says that G is the internal direct 
product of its normal subgroups H and IC defined as in equations 
(3.2,5) and (3.2,6) respectively. Thus, it follows [34 ,p.234] 
that G is isomorphic to the direct product of G^ and G 2 , i.A, 

i 

( 3 , 2 . 10 ) 


G 3: G^ X G 2 • 
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We summarize this result as follows: 

• G-iven transitive abelian permutation groups 
of order m and ^2 order n, the transitive abelian group G 
of degree and order N = m.n formed by the set of permutation 
matrices (p- (x\ j q[.elf', o'sZ , is isomorphic 

to the direct product of G^ and G 2 . : 

Having thus obtained one~ dimensional representations 
for two-dimensional signals and permutations, we are now ready 
to proceed to the final step - that of obtaining one-dimen- 
sional Representation for two-dimensional permu tat ion- inva- 
riant systems. This we do in the next section. 


5-5 1-D ,P~I System R epresentation for 2 -D P~ I ..Systems 

The various transformations involved in obtaining 1-D 
representations of 2-D systems are shown diagrammatic ally in 

3. 2. 


^ t 


Q 

Pig. 3.2: l-D Equivalent of 2-D P-I Systems 
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In this figure, 

V is the 2 — D signal space of all real m x n matrices, 

is the usual vector space of tuples of reals, and 

Q is a linear transformation from Y to (refer 
section 3 . 1 ). 

Further, I is any finite discrete linear system on Y 
and t is its l—D ec^uivalent representation under the trans- 
formation Q. 

The system t is in general given by 

t = Q TQ”1 (3.5.1) 

Suppose the 2 -D signals X, YeV are respectively the input and 
output signals for the system T and that x, yeR^ are the 1-D 
equivalent signals of respectively X and Y. Then we have, 

X = Q(X) 

y = Q(TX) = Q(Y) = tx = tQ(X) • (3.3.2) 

If we now suppose that T is a 2-D P-I system belonging to a 
certain class, we would like to examine xfhether its 1-D 
equivalent representation defined through equation (3.3.1) is 
also permutation- invariant, and if it is, then we would like 
to determine the class to which it belongs. To be specific, 
let T be a 2-D P-I system relative to G-^ of order m and 62 

Consider the 2-D signal X eV obtained from XeV as 


order n 
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Xp is thus obtained from X by permuting its rows by the 
matrix and the columns by the matrix q^e& 2 . let X^ 

be now given as input to T. Since T is a 2-D permutation- 
invariant system, using equation (2,2.4), and subsequently 
equation (5.2.4), 


“p = KPj, X = Pj.(b;)<i® 

QdZj,), = Q(pj^(irx)q,®) = (p^.® q^)Q(TX)- (5.3.3) 


In view of remark 5.2,1 and equation (5.5*2) we may 
now rewrite the above equation as 


Q(TX.) = P^(Q(TX)) = tx, (5*3.4) 

P P P 

where P is a permutation matrix belonging to the transitive 

Jr 

abelian group of permutation matrices G- which is defined by 
^ ^ 5 Pk ^ ‘^l^ * Pk^^l' q;2_eG'2. 

tOXp = t(pj^® q^)Q(X) = tPpX . (5.3.5) 


Ihen from equation (5.3.1), 

Q(TXp) = tQXp- (3.3.6) 

Prom equations (5.3.4), (5*3.5) and (5.3.6), we then have, 
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Pp t X = t Pj, X . (3.3.y) 

Since and are arbitrarily chosen/ of Gf-^ and ^2 
respectively, equation (3.5.7) is true for any arbitrary 
member of G-. 

Thus, equation (3.3*7) implies that t is a permutation- 
invariant system relative to a, a transitive abelian group 
of permutation matrices which is isomorphic to the direct 
product X ^2 and defined by 

f Pk®Q 'll} ' 

Thus, the following theorem is fully established: 

^ ^ is a 2-P permutation-invariant system 
on V relative to groups order m and ^2 order n, then 

tj the 1-D equivalent of T is also permutation-invariant; the 
permutation- invariance of t is relative to a transitive 
abelian permutation group G of order K = m.n formed by the 
set of permutation matrices { p^ 
q^eG2, jsZ^. 

Rema rk 3. 3^1: If T is a 2-1! P- 1 system, in view of theorem 
3.3.1, t, the 1-D equivalent of T under the transformation 
Q will be referred to as the equivalent 1-D P-I system of 
T under Q. 
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Having thus established the equivalence between 2-D 
and 1-D P~I systems, our next endeavour is to obtain explicit 
expressions throu^ which, given any 2-D P-I system T, its 
equivalent 1-D P-I system t can be fully determined under the 
assumed linear transformation Q from Y to 

let S be a class of 2-D P-I systems on 7, the space of 
real m x n matrices, relative to G-^ and ^2 orders m and n 
respectively. Then a system TeS is expressible as (Chapter 
P 33)* 


T = 


m-1 n-1 

I I s. , B. . 

i=0 3=0 i 


where, s^ ^ are the entries of s, the unit response matrix 

T and B. . are the basic 2-D P-I system of S. Therefore, for 
1,3 

any arbitrary signal XeV, we have, 


m-1 n-1 m-1 n-1 , m 

ra = ( J I s. i B, px = I I s. X ip . 

iio 0=0 ^'3 ^'3 1=0 0=0 3-. 3 1 0 


How let Q be a transformation which gives 1-D equivalents of 
2-D signals, let t denote the 1-D equivalent of T under Q. 
Then referring to equation (3.3.1), 


T = Q"*^ t Q 
TX = t Q X 


m-1 n-1 


i=0 3=0 ^ J 
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But QX = X, the 1-D eq.ui valent of X, under the transforma- 
tion Q. 


Therefore, 

.L s. (P^ X 4®) = j I <1^.) . 

1=0 j=0 ^ 3 i=0 i=0 1 3 


m-1 n-1 

.) 

0= 


But 


Q(p, X 


1^) = 


(Pf 



Finally, using (3.2.4) 


tx 


m-1 n-1 

y y s. .(p. (x) q.)x for every xeR 
i^O 0=0 1 '-tj 3 




i.e., t 


ni-1 n-1 

Jo Jo '■ 

(3.3.8) 


Thus, we have 


Theorem 3.3. 2: Let T he a 2-D P-I system belonging to a 
class S relative to groups 0^ and &£ orders m and n res- 
pectively. Then t, the 1— D equivalent of T under Q is given 
by 


m-1 





3=0 


^3 




v/ 


where the s. . 's are the entries of s, the unit response 

1,0 

matrix of T, Further, t is a 1-D P-I system relative to the 
G-roup G- (Theorem 3.2,1). 
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It would be more convenient if we put equation (3.3.8) 
in the conventional form, i.e., one wherein the system matrix 
of t is expressed in terms of the entries of its own unit 
sample response vector. Por this, however, we have to first 
establish a relationship between the N entries of the m x n 
unit response matrix s = Tq q of the 2-D P-I system T on the 
one hand, and the U entries of the unit sample Vector 
of the equivalent 1-D P-I system t on the other. The unit 
sample signal for tho 2-D P-I systems on Y has been taken 
(remark 2.1,1) to be Aq an m x n matrix with a 1 in the 
(0,0)-th position and zeros everywhere else? while the unit 
sample signal for the 1-D P-I system on is Sq, the N- 
length column vector with a 1 in its zeroth place and zeros 
elsewhere 


:i 

0- - 


- - - 0 i 

[ Q 

1 

0- - 
1 

- - - - 

o' 

1 

1 1 

1 

! 

t 


1 ^ 

• r ' 

0 

0- - 


0 




and Bq - (l O' 



How, we recall (remark 3.1.3) that the transformation Q from 
Y onto is so chosen that the (0,0)-th element of any 2-D 
signal XeV is always mapped onto the 0=th entry of the 1-D 
equivalent of X, Thus, 
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®0 “ ^ ^ 0,0 * 

Then from Pig. 3,3.1 it follows that 

s(°^ it eo= m = mo^o^ 5a(s), 

i.e. , 3^°^ = Q(s), (3.3.9) 

where is the unit sample response of the equivalent 

1- D P~I system t and s is the unit response matrix of the 

2- D P-I system T. Thus, in view of equation (3.3.9) and 
remark 3.2.1, we may now rewrite equation (3.3.8) as 

N-1 

where Sj^, keZ|^ is the k-th entry of the unit sample response 
vector of the 1-D P-I system t, and P^^ is the k-th member 

of the transitive abelian group of permutation matrices G- 
relative to which t is defined. Further, if f the index 
mapping associated with Q gives 


k= f(i,j) ; ieZ^, jeZ^, keZj^ ^ 


then 

k ^ 

and 

11 


(3.3.11) 


Prom the foregoing, it is clear that different linear 
transformations Q from Y to lead to different equivalent 
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1— D sysiiems foi' the same 2— D system T« The following examples 
illustrate this point and also help to consolidate our ideas 
regarding equivalent 1-D P-I systems for 2-D B-l systems; 

Examp le 3 » 3. « 1 ; let V be the space of real 2x3 matrices so 
that m = 2 and n = 3. Let j,* ie2^» the basis ele- 

1 J J Xl 

ments of V, be ordered lexicographically, i.e., the index 
mapping f associated with the transformation Q be 

k = f(i, 3 ) = ni + j = 3i + ie\» J^^n* 

lot Gr^ and Gg be transitive abelian cyclic groups of 
permutation matrices given by 

r- n r- — 

»1 = { Pq. Pi) . where, ^ and = 1^° i 

p, 

1 0 0 | 

and ^2 = { Iq, q^, 12 } » where, q^ = 1 0 1 0 i , 

f __v 

rb 0 i] 1 0 1 0 1 i 

q. = :i 0 01 , qp = |0 0 ir* i 

^ :o 1 o» ;i 0 0^ . 

If T, a 2-D P-I system relative to and G 2 has a unit res- 
ponse matrix s given by 

n? 1 0 1 

s = i • ' 

1 2 4 2 . 5 i f 

/' 

then for any arbitrary signal X 
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X 


Y Y Y 

; 0,0 ^0,1 ^0,2 

’\,0 ^1,1 ^1,2 


the 2-D P-I systora T is interms of the hasic systems, 
TX = X H. X + X + X 

+ 2 ♦ 2 ^ ^ 


The basic systems B. . are given by 

X, J 

®i,j ^ “ ^i ^ » Pi®\» ^®^2 


In detail, 
TX : 


1 o' r , !l 0 of 
3 i J o; [X] :o 1 0! + 1 

; 0 0 1 : 


,. To 0 l[’^ 

in '. [X] il 0 O! 
i-O X > 10 10 


•'l 0 


■* *1 0 Os^ 

+ 2 [X] jO 1 0| +4 

*1] {0 0 2.j 

r T To 10“!^ 

+ 2.5 iV [X] io «L 1: 

S-*- jl 0 0; 


0 li 

1 o; 


i_ 

To 0 li 

[X] 1 0 0* 


T 


IP 1 9> 


■(3Xo,o+^0,2-^2=^l,O+2.5Xi,i+4X^,2)f^0.O+3^0,r‘^l,O-^2X^,l-"^-^h,2> 

i(2Xo^o-"2-5Xo,i+4Xo,2+5h,o+h,2ff‘^o,o+2Xo,i'"^*5^o,2+h,o+3Xi,i^ 

< 

(2.5Xq^q+4X;q^^+2Xq^ 2+^^^^+5X^^2^ j 
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and Q(TX) 


■' (3Xo,o 

+ 

^ 0,2 + 2 ^ 1,0 + 

2.5X-, 

1 

+ 

.^ 1 , 

,2^ J 

“R 

o 

O 

+ + 4^1,0 + 

2 ^ 1,1 

+ 

2 . 


, 2 ) ! 

H 

o 

tj. 

+ 3Xq^2 + 

+ 4X, 

1 


2X. 

X j 

,2M 

: ^^^ 0,0 

+ 

^*5^0,1 ■^..^ 0,2 

+ 3 X 2 

.,0 h, 

'2^ i 

1 ^^ 0,0 

+ 

^^ 0,1 ■*■ ^*^^ 0,2 


0 

+ 


, 1 ^ i 

I (2.5X^ 

,0 

+ 4Xq^^ + 2Xq^2 


1 

+ 


.2)j 


The equivalent 1-D P~I system under the assumed transformation 
Q, represented by the system matrix t is given by 


- 1 0 0 ■ Q- 

3 lo T' ,0 1 or + 1 Ir 
-t.- 10 0 1« y \ 


[l o" 


'-S. 


!0 0 1 : 
•1 0 ot 
Q ;0 1 o': 
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Q ' 0 0 1 


iO 1 0’ 
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0> 
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+ 

1 

» 0 
io 
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0 

0 
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0 

0 
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0 
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0 

0 

0 

0 

0 
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.1 — — ■ 

) 3 0 1 2 2.5 4 i 

3 0 4 2 2.5 i 

0 1 5 2.5 4 2 > 

i « c 

2 2.5 4 5 0 1 : 

i 

^4 2 2.5 1 5 0 : 

, 2.5 4 2 0 1 3 ; . 

= (^ 0,0 ^ 0,1 ^ 0,2 ^ 1,0 ^ 1,1 ^^ 1 , 2 ^^* 

It may bo verified that t(QX) = Q(TX). 

Note that the unit sample response of the equivalent 
1-D P-I system t, represented by the zeroth column of the 
system matrix t, is obtained by reading off the entries the 
unit response matrix s of the 2-D P-I system, in a lexico- 
graphic manner, since in this example the index mapping f 
associated with Q is the lexicographic way of ordering of 
pairs of indices. 

Example 3.3.2; Assuming the same 2-D P-I system as in the 
previous example, let us now use a transformation Q that 
orders the basis elements A of 7 in accor- 

dance with the index mapping given in example 3.2.2, viz., 

k= f(i,j) - (3i + 4j)mod 6, ieZ 2 , jeZ^, keZg. 
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Then, TX = 

i ^0. 0^2- 5^0,1+42 o^ 2^3Xi, 0+h. 2 > < 4^0, 2«1, 

^^ 0 , 1 '*'^ 0 , 2 + 2 . g + 4 Xj ^^^+ 2 Z ^ 

C 2 . 53 ^ 0 , 0 + 4X0 , 1 + 2X0 , 2 +^ 1 , 1 + 3X1 

But Q(TX) is now given by 

■ ‘^Vo + Xo,2 + 2 X 1,0 + 2.5X^^^ + 4 X 1 , 2 )! 

( 4X0,0 + 2X0 ^^ + 2 . 5 Xp _2 + i 

Q ( TX ) = • '^ 0.1 ■" ^ 0,2 + 2 . 5 Xi,o + 4X1,1 + 2X1 ^ 2 ) : 

; ( 2x0,0 + 2 . 5 Xo,i + 4X0,2 + 3X1^0 + Xi ,!) ; 

(^ 0,0 + 3X0,1 + 4X1,0 + 2X1^1 + 2 . 5X1 !) i 
; (2. 5X0 0 + 4X0 1 + 2X0 2 + X + 3Z ) i 

-Ws*.. ' 


^ 1 0 0 r Ti o- 

3.01-S. *010: + ! 

- 1 -i ^ ■ 0 0 1 f L® 1 


; 0 0 1 : 

Tj 10 0 ; 

'Q : 0 1 0 , 


+ 2 ' 0 1 ' . X ' 

^ . 1 0 , ‘ X 


.10 0 
0 10 
0 0 1 


^ 4 4 "^ '° ° ^ 


1 o ®„ ;i ? 0 , 

Q ; 0 1 0 ' 


: 0 1 ' > 0 1 0 r 

+ 2-5 .£ 0 10 ;0 0 1 : 

iJ -. rj'^Q ^ 00 ; 
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Prom the given index mapping, 


QX 


that 


^^ 0,0 ^ 1,1 ^ 0,2 ^ 1,0 ^ 0,1 ^ 1,2 


vT 


tox 


^^ 1,0 ^ 1 , 2 ^ 


+ IX^ ^ + 2Xq^^) . 


) 


;(3Xo^O + Xq^2 

|(4Xo^O ■*■ 52^1,1 ^•5 ^'o,2 - --1,0 

;( 4 Xi^l + 3 X 0^2 + 2 . 5 X ^^0 -f IXq^^ 

(2Xq^0 + 4 X 0^2 + 5^1,0 2.5Xo^ 3L f a^l^2 

:^^o,o ■*■ ^^1,1-^ "^1,0 ^^0,1 '*■ ^*^^1,2^1 

j( 2 . 5 XQ^Q + 1 X]_^ 3 _ + 2 Xq ^2 + 4 Xq^^ + J 


+ iX -, o ) * 


= Q(Tx: 
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OlDserve the difference in the form of the system 
matrices of the equivalent 1-D P-I systems obtained in the 
two cases, under the different transformations used. The 
question then naturally arises: 'Are there some preferred . 
transformations which, for a given problem on hand, lead to 
a more desirable form of an equivalent 1~D P-I system for a 
given 2-1) P-I system’? This question has been investigated 
in depth in Chapter 6 in connection with 1-D implementation 
of 2-D filtering in the Fourier and Walsh domains. 

It must be pointed out that given the equivalent 1-D 
P-I system obtained under a specific known transformation Q, 
we can always reconstruct the original 2-D P-I system without 
any ambiguity. To be specific, let t be the equivalent 1-D 
P-I system defined relative to G, obtained under a known 
transformation Q from Y to Then, 

N-l 

t = V s 1 Pi 
ilo k 


where Sj^, keZjj are the entries in the unit sample response 
vector and Pj^, belong to G. 

Row, since the index mapping f associated with Q is 
one-to-one, any specific integer k belonging to Zjj is mapped 

onto a unique ordered .pair of integers (i,j), 

—1 

the inverse mapping f • Therefore, 


m-1 n-1 

iJo jlo ‘ 


(3.3.12) 



so that 


^ 'll (remark 5.2.1) and t = QTQ“^ 

for any xeR , 

tx = QTQ^^x = QTX ^ 

where X is the xmique 2~.D representation of x under the 
inverse transformation Q"^. Therefore, equation (5.5.12) may 
be written as 


m-1 n-1 

QIX = I I (S (p (X,. a )z), 
i=n isn 1 '-0 3 ■’ 


i.e., T2=Q-lC,I .1 3 

1=0 3=0 Q 


i=0 3=0 

m-l n~l 


m-1 n-1 T 

= ( I I 1 « (Pil^ q^XQX)). 

i=0 3=0 ^ -o J 


Q 


Row, using equation (5.2.4) » 


m-1 n-1 m m-1 n-1 

TX = J I 3. . p- X q^^ = ( I I s. . B )X 

i=o 1=0 ^ J iio 3=0 


for every XeV, 


S-! n- is given by (refer equation 2,5.1) 

X, J 

B. .X = p. X q? for every XeV 

1 > J X J / / 


where 
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Thus, since the s- .'s and B. 's, ieZ^, jsZ , are deter- 
mined uniquely from the respective s^^'s and keZjj of 

the given 1-D P~I system t, the 2-D P-I system T is uniquely 
determined from equation (3.3.13). 


3 . 3.1 Ei genval ues and E igenvectors o f the Equivalent 
1- D P-I S ystem 

Let T be a 2-D P-I system on Y and let T belong to a 
class S defined relative to G-^ and 0-2. If t be the 1-D P-I 
system that is equivalent to T under the transformation Q 
from V to R^, then we have, (refer equation (2.6,8)) 




mr-1 

) = (I 


'n-1 


ISO 


L ®k,l 4’*^ 4’h Q(hi'b . (3.3.14) 


But, Q(Th^»^) = t(Q(h^»^’)) = t(Q((h^)(h^)^)) = t(hVx)^ h^) . 
Using equation (2.6.9), equation (3.3.14) may be rewritten as 




(Jo 


Q(h|»^) • 


Thus, if h^»^ = (h^).(h^)^, is the i,a-th eigenvector of the 
2-D P-I system T, the corresponding eigenvector of t, the 
equivalent 1-D P-I system of T under the transformation Q 

from T onto R^, is given by Q(h^»^) = h^(x) h^ ,* and the set 

Q 
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cominoii set of eigenvectors of 

y 

the equivalent class of 1-D P-I systems obtained from the 
class S of 2-D P-I systems under the transformation Q. 

Also, if the index mapping f associated with Q be 

f • (l>j) -► P f ^^^n * 

Then, the p«th eigenvector of t^viz, , is given by 

Hg = Q(hJ^»^) ; peZj^, ieZ^^, jeZ^ ^ (3.3.15) ; 

where is the (i,j)-th eigenvector of the 2-D P-I 

system T, Further, if is the eigenvalue with which the 

eigenvector h^* ^ of T is associated, then the eigenvector 

of t is associated with the eigenvalue j 

'[ 

I 

Thus, we have arrived at explicit expressions for the f 
eigenvalues and eigenvectors of the equivalent 1-D P-I system I 
t in terms of the eigenvalues and eigenvectors of T, the 2-P P-! 
system from which t is obtained under a transformation Q, I 

¥e would like to point out that the properties of 2-D 
P-I systems discussed in Chapter 2 as well as the equivalence 
between the 2-D P-I systems and 1-D P-I systems discussed in 
the present chapter, could have been obtained by adopting a 
different approach, wherein we regard V, the vector space of 
all real m x n matrices, and equivalently, the vector 

space of all real N-tuples, as tensor product spaces. 



CHAPTER 4 


TRAHSPORM EOMAIH GHARACTERIZATIOH OP 
2-E P-I SYSTEMS 

In this chapter, first a generalized 2-D finite dis- 
crete transform of 2-D P-I systems is given and it is shown 
that the 2~D DL''T and 2-D DVT are special cases of this 2-D 
finite discrete transform (2-D PDT). This is followed by a 
transform domain description of 2-D P-I systems wherein it 
is shown that the 2-D PDT satisfies a generalized convolu- 
tional theorem. The notion of transfer function of a 2-D 
P-I system is next introduced and finally, the relationship 
between the transfer characteristics of a 2-D P-I system and 
its equivalent 1-D P-I system is discussed. 

G-eneralize d 2-D P i nite Dis crete T ransfo rm 

In section 2,6 it was shown that members of a class 
of 2-D P-I systems have a common set of linearly independent 
orthonormal eigenvectors which span the pertinent signal 
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space of that class. Utilizing this result, we derive in 
the present section a generalized 2-1) finite discrete tran- 
sform (2-D FDT) of 2-D P-I systems. 

Let T be a 2-D P~I system relative to and ^2 
orders m and n respectively and let U = m.n. Then, as shoxm 
in section 2.6, the set of eigenvectors of T, viz., h^»^ , 
i£Zm> form^a basis for the space ¥ of complex m x n 

matrices (refer to remark 2,6,1). Thus, any arbitrary 2-D 
signal xeV/ may bo written as 


a.. 

m.n 


m-1 n-1 . . 

I I n 

i4o j4o ^ 


1 

1 


m-1 n-1 - . rn 

I I h ' 

i=0 j=0 “ 11 


(4.1.1) 

In equation 4.1.1 we have made use of the fact that h^*^, the 
{i,j)-th eigenvector of T is equal to where h^ is 

the i-th eigenvector of the class of 1-D P-I systems relative 
to 0 “th eigenvector of the class of 1-D P-I 

systems relative to G 2 . ' ¥ow recalling that (see Appendix A) 
hj^ is the i-th column of uhe generalized Hadamard matrix of 
order m [ 55 ] equation ( 4 .I.I) may be put in matrix form as 




X 


N 



X H^) 


(4.1.2) 


Therefore, 

X = N(H~^ X (H^)"^) • 
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But H' 


'm 


m TH p 


where is the comple:^ conjiigate transpose of 


Therefore, 

X = HI X K 


■* T# T 


m " ” n • 

The above equation may be rew:’;itten as 


m-1 n*l 4 Jt-rn m-1 n-1 . . 


I I -i =1 1 -5 ^"1\r 

iio “1 3 ., 3 n ^ 4 q 1,0. N , 




where h^'^ is the complex conjugate of b^'^j ibe (i,o)-th 
eigonvoctor of T, Thus, 


X 


m~l n~l ^ 

h J. ^1,3 “h’’ ’ 

i=0 jr=0 


(4.1.5) 



T m-1 

n-1 

and 

^ = s 

" i=0 

3=0 

Us in 

g the relation 

vAf 

(4.1 

.3) and (4.1.4) 

al' 


m~l 

n-; 


X, . = y 

X Q 

1 


[ h^»J . 
i, 0 N • 


(4.1.4) 


1^) (h^’)^ 


ii— X XX— X ^ 


and X 




- m-1 n-1 V -i 

1 y y K’ ^\r r » 

^ Is^O 1=0 ^ k,l n 


,lVj 


ieZ, 


m» 


(4.1.6) 
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2)1ig pair of equations (4,1.3) and (4.1. 4) 
or alternatively, equations (4.1.5) and (4.1.6) will be 
called the ^enera.liged. 2 ~D finite d i scre te trans^^rm J 2-.p' FDl 
pair. X will be referred to as tbe 2 -D PDT of x, and x the 
inverse 2 -D PDT of X. 

Just as the matrices associated with the dis^ete 
Fourier transform (EFT) and the discrete ¥alsh transform (D¥T' 
are special cases of the generalized Hadamard matrix.. [35 ]j ; 

it can be shown that the familiar 2 -D DPT and 2 -D D¥T are 
themselves special cases of the 2 -D FDT enunciated above. 

We will now examine this question in detail. 

4 . 1.1 2 -D Dis c rete Fourier Tra nsfor m (2-D DPT) 

Suppose the system T considered in the previous section 

is a 2 -D cyclic P-I system^i.e., a 2 -D P-I system relative to G 

G-g which are cyclic permutation groups of orders m and n 

respectively. Since the number of invariants for a cyclic j 

Ic i ^ 

group is only one, r = 1 for as well as G2. Further, h^* 
the k-th entry of the i-th eigenvector of a class of 1-D P-I 
systems relative to G^ of order m and the 1-th entry 

of the j-th eigenvector of a class of 1-D P-I systems rela- 
tive to G2 of order n, will be given by (refer to equations 
A, 24 and A , 25 of Appendix A) 
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^k,i 

m 


Y 


-ki 

m 


, and 


:1» J 
n 


hZ"*' = Y 


Ij 

n i 


where Yp = expCV-l ~) , 

Thus, equations (4.1.5) and (4.1.6) take the form 


m-l n~l , . 

X - r r .,~ki 


k,l = ,1, ,• , (4.1.7) 


i =0 j =0 


and 


1 “Y “7^ ..ki 


X. . = ^ T y Y^^ X. T Y^^' #■ ie2 ,ieZ - ( 4 . 1 . 8 ) 


Equations (4.1.7) and (4.1.8) may be recognized as the 
defining equations of the 2-D IFT pair [ 40 ]. 


4.1.2 


2~p Discret e W a,ls h~Ha damar d _ Tran sf or m ( 2- D 


Dwiy 


Now, suppose that T is a 2-D dyadic P-I system rela- 

^1 

tive to the pair of dyadic groups of order m = 2 and 

rp 

G 2 of order n = 2 . Then (refer to equations A . 24 and A , 25 

of Appendix A) 



rk, 3 
m 

r^-l 

= n 
0=0 

— k i 

Y a a 

a 



and 

hl»3 

n 

11 

f 

0 1 

H 

Ya 

r 

P 


(4.1.9) ^ 

(4.1.10) 
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where = expCV-l = -1 


and and are now digits in the binary expansion 

of the integers k,i,l and j respectively so that they are 
either 0 or 1. Therefore, we may write 


‘m 


and h 


i»d 


n 


"^1-1 k 1 

n (- 1 ) “ “ 

. T 

- (- 1 )“^® 

0 

if 


^2-1 1 j 

n (-1) “ “ = 

. I" 





I Ic.leZ^ , 


(4.1.11) 




a=0 


1.3eZ„. 


(4.1.12) 


h^^^ and h^^^ as given by equations (4. l.ll) and (4.1.12) are 
recognized to specify discrete ¥alsh functions in what is 
called Hadamard order or natural order [ 36 ]. Substituting 
for and h^*^ in equations (4.1.5) and (4.1.6) of the 

2-D PDT pair gives 




r2-l 


X 


k,l 


m-l n-l 

I I 

i-0 j=0 


U JU JLJ- JU 

I- 


Va „ L 


a^V 


a=0 


a 


j (4.1.15) 


^1-1 


r2-l 


and 


x. . 


■ ■ it) Jo ; 


JT y y T (~l) 

^ kSO l4o 


(4.1.14) 
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Eciuai/ions (4*1»13) a.nd (4»1«14) are now recojgnizod [37] 
as the 2~D Walsh-Hadamard transform (2-f D¥r) pair with the 
transform in the natural or Hadamard order. A sequency 
ordered form of 2-D DW can be obtained by writing h^»^ and 
h^^^ in the modified form given below. 


V ^1”^ ' k (i ' + i 

h^' = n (-1) “ ^1"“ 3?^-a-l 


) 


a=0 


ri-1 


(- 1 ) 




a=0 


!■ k, ieZ^ , 


and 



a=0 

I ^a^^*r2’-a^ ^r2-a-l^ 

(-1)“=° }■ 1, jeZn • 


In this form, h^*^ and h^* specify discrete Walsh functions 
in the sequency order and when they are in this form, we 
shall denote them by w^'^ and respectively. 

Correspondingly, the 2-D PDT now takes the form 


X, 


'k, 1 


m-1 

,i 


n-1 

I, 


w. 


k,i 


i=0 3=0 


m 


s:. . w_ 

i» J n 


rl»J 


(4.1.15) 
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j 


■1 m-1 n~l , 

Tr T y X 

^ k?lo lio ^ 


k,l * 


(4.1.16) 


When written in the matrix form, this sequency ordered 2-.D 
DWT pair hecoxnes 


¥ X 

m n y 


i 


(4.1.17) 


(4.1.18) 


where/ and are sequency ordered Hadamard matrices of 
orders m and n respectively. The pair of equations (4.1.17) 
and (4.1.18) is called the sequency ordered 2-D DWT pair [36]. 

Having shown that the 2-D DPT and 2-D DWT follow as 
special cases of the 2-D FDT, we will now examine some "basic 
properties of this generalised transform. 


4.1.3 Basic P rope rt ies of t he 2-D 

(l) Linearity: According to this property, if T(x) denotes 
the 2-D PDT of a signal xeW then 

T(a^x + a 2 y) = 0 C 2 ,l(x) + a 2 T(y) ,* for every 

x,yeW ; a^,a 2 eC! , 

where W is the vector space of m x n matrices with entries 
from C. This property follows directly from the way the 
transform itself has "been defined. 
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(2) Normalization property; (T( Aq^q^^Is: (k,l)-tli 

element of the 2-D ,FDT of the 2-1 unit sample signal, 

^ 0,0^ eQ.uals 1 for every k belonging to and every 1 
belonging to Z^^ 

i.e., (T( ^o,0^^k,l “ ^ every keZ^, every le2^. 


To verify this, put x = Aq^q in the equation (4.1.5). 
Since = 1 and all other elements of x are zero, it 

follows that 


m-1 n-1 , . ^ T ^ 

i,i = Jo Jo ^ ^ • 




h^' for k = 0,1,2, - - - , (m-l) represents entries in the 
zeroth column of li^. Similarly, h^^^ for 1= 0,1,2, -- - , 
(n-l) represents elements in the zeroth column of H*. But 
all the entries in the zeroth columns of H* and H* are equal 
to 1. Therefore, 


^k 1 ^ every keZ^ and every leZ^^ 


i.e., (T(A 0 O^^k 1 " ^ every keZ^ and every IsZ^. 

(3) Permutation Property; This property relates the 2-1 PIT 
of any 2-D signal x with that of a permuted 2-1 signal z 
obtained by permuting the rows and columns of x by members 
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of "fcrs.nsi'tiVG slDoliciii pGmi'u.fs.'tioii ■^ro'u.ps G'^ 3 ,iid. of sippro"* 
priate orders. To be specific, it says that if Z is the 2-P 
FDT of X and X, the 2-D PDT of x, where x = p x ; p eGt , 

- -^p ^q. » -*^p 1» 

q.qe^>2» 


X 


k,l 


irlyO. Y 

% % ^k, 1 * 


.T 


Proof; Since x = p^ x q.^^, from eq.uation (2,3*5) we kn'ow that 

~i ,3 ~ ^i(“)p>O 0l9. symbol 0 denotes pointwise sub- 

traction in the mixed-radix number system with the invariants 
of forming the mixed- radices, and the symbol PI denotes 
pointwise subtraction in the mixed-radix ninnber system whose 
mixed radices are the invariants of Therefore, 


X 


k,l 


m-1 

n-1 

h^»^ 

T h ^ ^ 

~i,a 

lo 

1=0 

Jo 

m-1 

n*-l 

vk,! 

hi 


Jo 

Jo 

^i0 p, j {=lq 




How, put i0) p = r and j Q' q. = s 


T-ljq^-sL^s 4 

jlo 


But, in view of equation A. 24 of Appendix A, we may write 


^k,p(t;r ^ ^k,p ^k,r ^nd h:!:''^—' " = h:^»'^ h: 


m 


m 


s ^ rl,9 

n n n 
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m-1 n-1 


' = I I ^ Hi'i hi’® 

'=0 s=0 ^ ^ r,s n n 


■k,l 


—v Ti — 1 n n— 1 , 

io io = 


r=0 s=0 


Finally, since 


m-1 n-1 


Io in = ^k,l equation 4.1.5) 


r=0 s=0 


we have 


X 


k,l " m 


h^'P X, 


k,l 


This completes the proof of the permutation property of the 
2-D FDT. 

4.2 Transform Domain Des c riptio n of 2-D P- I System s 

We now present a transform domain description of the 
2-D P-I systems. ¥e show that the 2-D FDT satisfies a gene- 
ralized convolution theorem and that Parseval's theorem 
applies to 2-D P-I systems. The notion of transfer function 
for 2-D P-I systems is then introduced and finally the rela- 
tionship between the transfer characteristics of a given 2-D 
P-I system and its equivalent 1-D P-I system is examined. 
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4.2.1 Generalized . _G.onyolut ion Theorem 

A generalized convolution theorem for 2-D B-I systems 
may be stated as follows; 


.'2 h,e_or em _4.. _G...l « The 2— D PDT of the generalized convolution of 
any two 2-D signals is equal to the pointwise product of the 
2-D PDT’s of the individual signals. 

Thus, if s and x be two 2-D signals and 


y = s # X, 


where * denotes generalized convolution given by (refer to 
equation 2,4,3) 



m-1 n-1 

Jo Jo ^1,3 , 


(4.2.1) 


then according to the generalized convolution theorem, 


"^k,! “ ^k,l* ^k,l ^^^m' ^^^n ^ 


( 4 . 2 . 2 ) 


where Y,S -and X are the 2-D PDT’ s of respectively y,s and 
X, i. e, , 


m-1 n-1 V .? —1 

= Jo h ^i.3 > 

^ (4.2.3) 


S, 


m-1 n-1 _ 


,1 = Jo Jo 



96 


and 


k,l 


m-1 n-1 . . 

I I y. . 

i=0 i=0 ^ n *■ 


f keZ^,leZ - 
m' n 


(4.2.5' 


of the generalized convolution theorem: Prom equa- 
tions ( 4 . 2 . 1 ) and ( 4 . 2 . 5 ) we have 


m-1 n-1 

i=0 jlo ^ 6- 


p=0 qLo '^G)P»3Sa ^P, 


m-l n-1 m-1 n-1 

■ lio qio "'p.a Jo lo V^i0p,3j3qEl' 


Putting 10 p = r and jQq = t, 


1 = P ( +) r and j = q f+J t * 


m-1 n-1 


m-1 n-1 


^k,l " ^P q I I 

p=0 q=0 P»^ i4o -tliO “ r,t n 

(4.2.6) 

But. h^.P©r= Efc.P 


^ (from equation A, 24 . Appendix A). 


Eq.uatioii (4*2,6) may be rewritten 


as 


pfo qlo lio tlo ®27,t ^ 


m-1 n-1 


H 
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m-1 n-1 p, m-l n-1 , . . 

pc=0 q=0 ™ P»9 n m r,t n * 


In view of equations (4*2.3) and (4.2.4), the above 
equation may be rewritten as 


’^k,! “ \,1 \,l , 


(4.2.7) 


This completes the proof for the generalized convo- 
lution theorem. 

4*2.2 Pa rs ev al ' s Theore m 

Theore m 4. 2.2; Let x and y be two 2-D signals belonging to 
W, the vector space of m x n matrices having entries from G, 
and let X and Y be the 2-D PDT’s of respectively x and y. 
Then, 


m-1 n-1 m-1 n-1 _ 

I y X Y, , = F y I i Yi i J ^ 
k=0 1=0 i=0 j=0 ^>2 * 

( 4 . 2 . 8 ) 


i=0 j=0 


where the bars over Yj^ ^ and indicate the respective 

complex conjugates. 

Proof I 


and Y 


k,l 

m-1 

= I 
1=0 

H O 

m 

H1»3 

, X 

k,l 

m-1 

-Jo 

n-1 

Jo 

y. . 

3a 
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Hence, 


Ill’ll n^**! i , 
iC,i K,± m 31 / 


m-1 n-1 , ^ 

.( V y V h^>^) 

pio qio 


m-l n--l 


i I \ 1 1 

feO 1=0 


m-1 n-1 m-1 n-1 m-1 ,, . , „ n-1 

£k,x ^k. 


l l Ja L 

io-i^n i-=0 0=0 ] 


m 




i=Oj=0 ^*=0 q=0 k=0 

From the orthogoD*ality property of the columns of generalized 
Hadamard matrices and H^, we have 


X = “ ®i,p , 


lc=0 

n-1 


and y hi»^ lii’ ^ = n 6_. 

M ^ AX XX 


ISO 

Therefore, 


OM * 


m-1 

I 

k^O 

H O 

h^A' 

X, . 
k,l 

^k,i 

m— 1 

n-1 

m-1 

n-1 

I 

I 

L 

L 

i=0 

3=0 

p=0 

q=:0 


m-1 n-1 _ 

B I I i 1 >■ 

iio JSO ^'3 1.3 


H = m.n 




y 
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4«2»3 ipjli.. of 2~D P— I Systems 

Kig g^©iiGX‘<iliZ6d con'VolU'tion ‘th. 60 ]i? 6 iii studied in sGctiou 
4.2.1 states that the 2-D PDT of the generalized convolution 
of two 2-D signals s and x eQ.uals the pointwise product of 
the 2-D PDT's of the individual signals s and x. If s and x 
are now taken to represent respectively the unit response and 
the input si,gnal of a 2-D P-I system belonging to a certain 
class, we then have 


'k.l 


\ 1 ^k 1 

JX f JL iX J« 


f keZj^, leZ. 


j ^ 

n; 


(4.2.9) 


where^ ^k,l* ^k,l 1 ^®P^®sent the (k,l)-th components 

of the pertinent 2-D PDT's of respectively the output y, the 
unit response s and the input x of the system. 

The matrix S, having entries keZ^^, leZ^ and 

obtained as the 2-D PDT of the unit response matrix s of the 
system, is henceforth said to represent the transf er .chara- 
c t eristic 8 of the system under consideration. Since the 
entries S.,^ are in general complex, the matrix S may be 

(a) (p) 

specified in terms of two separate matrices S and S 
Matrix S^’^^ whose each entry is ike value of the ampli- 
tude of the corresponding entry of S, is said to repre-H 

sent the . .amplitude characteristics or the ^pli'^ude . r^espon^ 

/p) (P) 

of the system, while the matrix S^ whose each entry Sj^^^ 

is the value of the phase of the corresponding entry Sj^^^ 
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of S, is saic! to represent the £kase_G_toacleristics or the 

of the system. Purtlier, for a 2-D P-I system 
belonging to a known class and specified in terms of its 
unit response matrix s, the following equation giving the 


2-D PDT of s, viz. , 


S 


k,l 


in-*l 

Jo 


n-1 

I 

0=0 


h 


k,i 


1^1 » 3 


m 


3 . . h' 

1,0 n 


keZ, 




( 4 . 2 . 10 ) 


may be rcgarcJed as giving the values of a function S;Z^ x Z^-»- C 
and in this sense, it is said to represent the transfer 
function of that 2~D P-I system. 


In particular, when the 2-P P-I system under conside- 
ration belongs to the cyclic class, i.e. , when the groups 
and Gg relative to which the system is defined are cyclic 
groups, the 2-D PDT pertaining to this class becomes the 2-D 
DFT, Thus, for the cyclic class of 2-D P-I systems, the 
transfer function becomes a function whose values are given 
by the 2-D DFT of the unit response of the system, i.e.. 


X '• 




where and y^ are respectively the m— th and the n—th roots 
of unity and are given by 


= exp(lf-l and Y„ = exp(V-l ■ 


2n 
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Then, in terms of the indeterminates or algebraic variables 
and Zg, the transfer function is explicitly the function 


m-l 

S(Z,,Zp)= I 
^ ^ i=0 


n-1 




-i 

1 





As an illustration, if a cyclic 2— D P-I system with 
a unit response matrix given by 


r ^ /% 

0,0 

®0,1 

®0,2 '"7 

S « ! 

1 m 

H 

■*« 

0 

®1,1 

®1,2 1 

is considered, then 

1 

Ic > X Q 

3I0 

®i,3 1^3^^= "0,0 + =0,1 rf 


—21 -k 

-f So^2 Y3 + ^2 + ^1,1 




Y^*+ 


-k -21 


where Y2 = exp(V-l = -1 aiid = expCf-l - 

Thus, for this cyclic 2-1) P-I system, the transfer 
function is given by 


S(Z^,Z2) - + Sq^3_ 




+ s 


1,0 



+ 2i 
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notion of transfer characteristics and 
transfer functions, when considered exactly as in the 2-D 
case, but with respect to a single index, a single transi- 
tive abelian permutation group and a single indeterminate, 
gives the corresponding notions for 1-D P~I systems. They 
have earlier been used in [i], 

4.2,4 JAggnyalu os of the. 2 - D P-I Sy stem and Entries of 

its T r ansfer Characteristi cs 

The entries of the transfer characteristics, viz, , the 
Sj^ I's of a given 2~D P-I system T have been defined earlier 
(section 4.2,3) as the components of the pertinent 2-D PDT of 
the unit response matrix s of that system, ¥e shall now show 
that these S, ,‘s are indeed the eigenvalues of the system T, 

iCyoi I 

As we shall see in the next chapter, this point of view will 
be useful in the discussion on the role of 2-D P-I systems 
in filtering or spectrum shaping of 2-D signals. 

Let T be a 2-D P-I system belonging to a certain class 
let x,y and s belonging to V be respectively its input, out- 
put and unit response. Further, let X,Y and S be the perti- 
nent 2-DPDT's of x,y,and s respectively. Then from the 

1 

generalized convolution theorem we have 

; ieZ^, 


Y. . = X. . S. . 
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y, the inverse 2-.D I’D! of Y is given by 



1 

m-1 

n-1 

y ss 

f 

1 

1 

d-0 


i=0 

where h^* 

d 

f 

ieZ , 

m* 

jeZ, 


orthonormal eigenvectors 


0 - 

i,j ■ 


1 

N 


m-1 n-1 


T Y X. . S. - hi»^ 

i=0 jLo ^ * 

(4.2.11) 


is the sest of linearly independent 
of the class to which T belongs. 


But 

and 



n-1 . . 

t X. . hi»^ 


♦ 


y = Tx = 


m-1 n-1 


i=u 0 
m-1 n-1 


lo 


, m-i n-x . . . . 


(4.2.12) 


where is an eigenvalue of T, the associated eigen- 


vector for it being h^'^. 


From (4.2,11) and (4.2.12) we then have 
m-1 n-1 

io , 

Now, the eigenvectors linearly indepen- 


,i„ -X = ° < 


dent. Hence, we conclude that 




X. .(S. - = 0 for every ieZ^ and every jeZ^. 

But X. .’s, being entries of the 2-D FDl of an arbitrary 

3 ■ 

input signal, are themselves arbitrary, so that we have 
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”* ^ every ieZ^ and every jeZ^ , ^ 

■“ every ieZ^^ and every jeZ^. ^ 

Thus, wc have the following theorem: 

* The entries of the transfer characteristics 
S ol a given 2— 'D P—I system T which are the components of the 
pertinent 2»-D POT of the unit response s of that system T, 
are the eigenvalues of T, Specifically, the (i,5)-th element 
^i,j* ^^^n ^ (i,;3)~th eigenvalue of T and has 

hjj* , the (i,;|)~th eigenvector of T associated with it. 

.fie. m . ark 4t view of theorem 4.2.2, we shall henceforth 

use the same symbol for the system eigenvalues and the entries 
of the transfer characteristics of a 2-D P-I system. 

4. 2.5 Relationship 'l^etween the Tran sfer Ch arac teris tics ^ 
of a 2-«D P-I System and its 1- P Equiv alent 

In section 5 of Chapter 3 we had studied the relation- 
ship between the unit responses of a 2-P P-I system and its 
equivalent 1-P P-I system. We will now study ^ the correspon- 
ding relationship in the transform domain^ i.e., the relation- 
ship between the transfer characteristics of a 2-D P-I system 
and its equivalent 1-D P-I system. 
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Lot the m X n array be the transfer characteri- 
stic of a 2-D P-I system T whose unit response is given by 
s^^\ Then from equation (4.1.3), 


S 



m-1 



3=0 


( 2 ) 
i, j 



(4.2.10) / 


where h^^^ is the complex conjugate of the (i,j)-th eigen- 
vector of T, 

Now, lot t be the 1-D equivalent of T under a linear 
transformation Q: Y bF and let f be the index mapping 
associated with Q (Chapter 3). If is the unit sample 

response vector of t, from equation (3.3.9) we know that 

s^^^ = Q(s^^^) . (4.2.11) 


Therefore, if (i, 3 *) •> k under the index mapping f, then 


S?2) = g(l) (4.2.12) ^ 

1,3 k y 

where sP^ is the (i,3)“'fcii entry of and sl^^ 

is the k-th entry of s^^^ Further, the k-th eigenvector 
of t, viz,, is given by (refer to equation (3.5.15)) 

hJJ = Q(4'h = «((l4)(hj)h , (4.2.13) 

Equation (4.2.10) may be written as 
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s(2) = Y sY = «-^(Y sY . 

]c=0 te^O 

(l ) 

where S' is the transfer characteristic -vector of t. Thus 
we have established the following result about the transfer 
charaotoristios of 2-D systems and their 1-D equivalents: 


Remark 4* 2. S ; Lot 1 bo a 2-13 P-I system on V and t on be 
the 1-D equivalent of T under a linear transformation 


Q; V 


r“* 


If S 


( 2 ) 


and S 


( 1 ) 


bo the transfer characteristics 


of the 2-D P-I system T and its 1-D equivalent t, then 


S 


( 1 ) 


Q S 


( 2 ) 



CHAPTER 5 

P-I PILTBRIHG- OP FINITE EISCRETE 2-D 

DATA 

In Chapter 4 the 2-D FDT was introduced and a trans- 
form domain description of 2-D P-I systems was also given. 

In tho present chapter, we first introduce the notion of 
filtering or spectrum shaping of 2-D signals using 2-D P-I 
systems and indicate the nature of filter types like low 
pass, high pass, band pass and band elimination filters with 
special reference to the cyclic and dyadic classes of 2-D 
P-I systems, ¥o then consider the notion of separability 
and study the sample domain as well as transform domain 
characterization of separable 2-D P-I filters. Finally we 
give examples illustrating the implementation of separable 
2-D P-I filters. 
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5.1 F4it§£iSiS^Ua^^^ 

let T be a 2-.D P-I system on V belonging to a certain 

class whose oi. ;onvoctors are represented by 

^i»j^ ®®'*' eigenvalues of T and if 

i, ■ .i 

the eigenvector be associated with the eigenvalue S. 

then 

T h^>^ = h^*^ f for every every jeZ^. 


Consider an arbitrary 2-D signal xeV, Then from equation 

( 4 * 1 . 4 ) > 


X 


1 

N 


, ». n«l j ^ 

Jq i-o ^ 


m-l 
i^ 


T 


N 


m-l n-1 

.1. I ^ 


» 3 ♦ 

% 




i 4 o 0=0 

(5.1.1) 


low, if signal x is given as input to the system T, the resu- 
lting output y is given by 

y 

y = Tx . 


Substituting for x from equation (5.1.1) » we have 



T 


m-l 





iDf-l n-1 

1 




Y X. . S, . 

Lq x>j 
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"I ni~l n— 1 . 

Thus, y = T(x) « | J T X. , s. .. 

^ ISO pO ^’3 


(5*1.2) 


while , 


m«l 



n-1 

,lo 



(5.1.3) ^ 


Equations (5.1.2) and (5.1.3) show precisely the way the 
spectrum of a signal x gets altered in passing through the 
system T. Each spectral coefficient X. . of the input signal 
gets changed into a spectral coefficient S. . X. . at the 
output, the being the eigenvalues of the system T, or 

equivalently tho entries of the transfer characteristics of 
T. The process of passing a signal through a system to pro- 
duce such an effect on the spectrum is commonly referred to 
as filtering or spectrum shaping of a finite discrete 2-D 
signal xeV, In keeping with this nomenclature, a 2-1) P-I 
system is here called a 2-D P-I filter if the process of 
convolving a finite discrete 2-D signal vdth its unit res- 
ponse produces the desired modifications in the spectrum of 
the signal. It may be noted that just as the filtering per- 
formed by LTI systems is with respect to the complex exponen- 
tials which arc the eigeiTsignals of those systems, in the 
present case the filtering is with respect to the eigen- 
vectors of the pertinent class to T-diich the 2-D P-I system 
T belongs. In particular, if T belongs to the cyclic class, 
the filtering is with respect to discrete complex exponen- 
tials and is termed as Pourier domain 2-D P-I filtering. 



no 


On the other hand, if T belongs to the dyadic class of 2-D P-l 
P—I systems, the filtering is then with respect to discrete 
Walsh functions and this filtering is called Walsh domain 
2~D P-I filtering. 


^ , In tho case of 2~D cyclic P-I filters which perform 2-D 

.fourier domain filtering, the pertinent eigenvectors are 

^n given by 



(l Yjjj, Yjjj • • ♦ • 



(m-l)iNT 
'm ■ 


a, 


(1 y; 


,(n-l)o 




whore = oxp{^-l f ) • 

Thus, and h^, iE2^, are vectors with discrete complex 

exponentials as their entries. In keeping with the general 
practice [38] the integral index i of h^ (and similarly j 
of h3) will bo called fr,§auenS2. 


In the case of the 2-D dyadic P-I filters which perform 
2-D Walsh domain filtering, the pertinent eigenvectors are 

where w^ and w^ denote respectively 
tho i-th column of the sequency-ordered Walsh-Hadamard matrix 
of order m and the 3-th column of the sequency-ordered 
Walsh-Hadamard matrix of order nf since we are dealing with 
the dyadic case, m and n must be some integer powers of 2. 
Therefore w^ and w^ are vectors with discrete Walsh functions 
as their entries and for which [39] the integral index i of 

w^ (or the j of w^) is referred to as the sequency. 
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Classification of 1-D P-I filters of the cyclic or 
dyadic class as low pass, high pass, band pass and band 
elimination filters is based on the fact that the pertinent 
eigen signals for the 1— D case involve only one frequency 
or sequency variable and so can be ordered in increasing 
order of frequency or sequency. In the 2-D case, however, 
two frequency or sequency variables are involved and hence 
classification of 2-D cyclic and dyadic P-I filters into 
types like low pass, high pass, band pass and band elimina- 
tion filters can bo done in several possible ways. Pig. 5.1 
shows what are called the rectangular ideal amplitude chara- 
cteristics of 2-D cyclic P-I filters of these various types. 
Ideal rectangular transfer characteristics of 2-D dyadic P-I 
filters of various types are shown in Pig, 5.2, In these 
figures, a band is that portion of the amplitude chara- 
cteristics where is greater than a 

prescribed value and a § top band is that portion where A, . 
is less than a prescribed value. It may be observed that 
the amplitude characteristics of the cyclic class exhibit an 
even symmetry. This symmetry arises from the 2-D DPT proper- 
ties and the fact that the entries of the unit response matrix 
are real [40]. 

Implementation of 2-D P-I filtering may be either 
explicitly in the transform domain or in the sample domain. 








(n) 1 owpii'.', 


(b) High pass 



n PA’;S BAND 

mnUftiiO 


□ STOP BAND 


FIG. 5-2 IDEAL RECTANGULAR AMPLITUDE CHARACTERISTIC^ 
OF DVADIC 2-D P~I FILTERS . ! 
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The transform domain implementation is based on the trans-- 
form domain oharaotorization of the 2 ~d P-i filter, viz., 

^k,l ®k,l \,1 ^ 

This implementation consists of three steps in cascade : 

(i) taking the 2~D PUT of the 2-1) signal x, (ii) multi- 

plying in a pointwise manner the 2-D PDT coefficients X, , , 

Kfl 

keZ^, le2^ of X by the corresponding entries keZ^, 

ieZ^ of the desired transfer characteristics of the filter, 
and finally, (iii) taking the inverse 2-D PDT of the resul- 
ting array. If the 2-D P-I filter is of the cyclic (or 
dyadic) class, stops (i) and (iii) are generally carried out 
using 2-D fast Fourier transform (or 2-D fast Walsh trans- 
form) techniques. 


The sample domain implementation is based on the 
convolutional relationship. 


m-1 n-1 

^k , 1 Q ^ ^ ^3) ^ ^ hfi 3 t > 0 


f keZa. 


lez; 


n 


and consists of executing the various arithmetical opera- 
tions involved in this convolution, throu£^ appropriate 
computational algorithms. 
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5.2 Separab l e 2~ D P-.I P litertg 

The question of using 1-D tecimiques for processing 
2-.D data was discussed earlier in Chapter 5 and it was shown 
there that every 2-.D P-I system has an equivalent 1-D P-I 
system which makes possible the conversion of 2-D filtering 
problems into exactly equivalent 1-D filtering problens in so 
far as finite discrete data are concerned. While this 
equivalence provides a general method, a more straight-for- 
ward application of 1-D techniques to 2-D tasks arises in 
cases where the specified ideal transfer characteristics of 
a 2-D P-I system are of what is known as the separable type, 

DefinitlrOn g . 2.1; The transfer characteristics of a 2-D P-I 
system T defined relative to '^2 orders respectively 

m and n, are said to be separable if the transfer characte- 
ristics matrix S can be represented as 

3 = (5.2.1) 

so that may be treated as the transfer characteristic 
vector of some 1-D P-I system of dimension m defined rela- 
tive to and as the transfer characteristic vector of 
some other 1-D P— I system H 2 of dimension n defined relative 
to G- 2 . a 2-D P-I system with separable transfer characteri- 
stics, is said to be separable. 
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The above definition of separable 2~D P-I systems is 
transform domain oriented. A corresponding sample domain 
definition of separability easily follows, let s be the unit 
response matrix of the 2-D P-I system T and let s^ and S 2 be 
the unit response vectors of the 1-D P-I systems and H 2 
respectively mentioned in definition 5.2.1. Then 

m-1 n— 1 , . m 

S = Y f 

i4:0 ^ 


s2 = T a| S3 . 

C XI 




It then followo from definition of separability that 


m***'l n**l «2 rp iD.**l • n*"! • 

ilo 3 Jo "1.3 


a 


m-l n-1 


=0 i— 0 12m n j 




i.e 


• > 


t 


n-i 


s^) (Sp'^' = 0 


T 


i=0 0=0 




( 5 . 2 . 2 ) 


Since the eigenvectors h^ ^^^m* ^^^n linearly 

independent, equation (5.2.2) implies that 
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~ every every ^jeZ^ 

or, equivalently that 

® = ®1 (5.2.4) 

It is seen by reversing the arguments that (5.2.4) implies 
(5.2.1). Thup, 

Jk§PJ!£S-5A.i.A.3it • A 2»D P-I system T defined relative to the 
groups of order m and ef order n is separable iff its 
unit response matrix s can be represented as 

where s is the unit sample response vector of a l-D P-I 
system of dimension m defined relative to the group 
and ^2 is the unit sample response vector of another 1-D P-I 
system H 2 of dimension n defined relative to the group ^ 2 . 


5.2.1 Representing Se parab l e 2-D P-I_..S.YS.tems in. terms 
of P-I Matrices 


A separable 2-D P-I system T has a simple represen- 
tation in terms of P-I matrices as we shall presently see. 
If T has a unit response matrix s, then 

® ~ ^ 0,0 “ ' 

But s and s« , being the unit sample response vectors 

'■ 1 " , ^ ^ 
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of sysfoms &nd H2 3^8sp6c*ti'V‘0ly^ a.3?6 fho zopofh. 

colunuas and H2 of the corresponding system matrices 

and H2 respectively j i.e, , 

®1 ^1°^ ®2 == ^2°^- (5.2,5) 

Therefore, 

" = ’^0,0 = (h(0>)’^ . 

The standard response matrices T^^ ieZ^^, jeZ^ of the system 
T are given by (refer to section 2,1) 


®i,j % ®0,0 = Pi 

- (Pi H^°))(q. 40))'^ p-ea^^; ieZ^, <li^<^2» 

(5.2,6) 

But i-th column of the system matrix H^, 

and ^2*^^ ~ the j-th column of the system matrix H 2 , 

Therefore, equation (5.2.6) may be written as 

T, , = (H^j^)^. 

jL f 3 ^ 

But T. .’s being standard response matrices of T, for any 
*» J 

2-D signal xe?, we have, 


Tx 


m-l n*l m-i n-i „(i),g(j)^T 


m-1 n-1 


or, Tx » X H 2 » 


Thus it has been shown that if T is a separable 2-J) P-I 
system defined relative to and ^2 of orders m and n res- 
pectively, then T is given by the explicit relation 

Tx = X h| ^ (5,2.7) 

where and H 2 are m x m and n x n P-I matrices represen- 
ting 1-D P-I systems defined relative to and ^2 respecti- 
vely. 


On the other hand, if a 2-D P-I ss^stem T is given by 
the relation (5*2.7) then as we shall presently see, it is a 
separable 2-D P-I system. 


let 6^ denote the m x 1 vector (0,0,.'.,., 1,0, ..,,,0) 
in which the i-th entry alone is a 1 and all the other entries 
are zeros, and 6. denote the m x 1 vector (0,0, , . , , ,1,0,, , 

m 

.,,0) in which j-th entry alone is a 1 and all other entries 
are zeros. Then the standard response matrix ^'^^n 

may be written, 


T 


T A 


if j 




(H^ 6i)(H2 6^-)^* 


■/ 


Since 6^ 


the i-th column of H, 
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Thus, 


s 


T 


0,0 


H. 


( 0 ) 


( h (°0 


T 


s. 




Then from theorem 5.2.1, it follows that T is a separable 
2-D P-I system. Thus we have fully established the following 
result; 


• A 2-D P-I system T defined relative to of 
order m and ©2 order n is separable iff it can be chara- 
cterized by a relation 

Tx =s ^ ^2 # 

Where and Hg are m x m and n x n P-I matrices representing 
1-D P-I systems defined relative to 0^ ^©spectively. 


5*2.2 ^anvQlut .3 eparable_^^ 

P-I Sys tems 


The generalized convolutional relationship for 2-D P-I 
systems derived in Chapter 2 takes a simple and interesting 
form in the *base of separable 2-D P-I systems. If s is the 
unit response matrix of a separable 2-D P-I system T relative 
to 0^ of order ra and ^2 order n, then from theorem 5.2,1, 


s 


k,l 


ss S' 


s 


2 ^ 


( 5 . 2 . 8 ) 


oJ • 

,4iere ^ is the k,l-th entry of s, is the k-th entry 

of the unit sample vector of a 1-P P-I system defined 
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relative to and is the 1-th entry of the unit sample 

vector of a 1~D P-I system Hg defined relative to G 2 * 

The generalized convolutional relationship for 2-1) P-I 
systems was shown to be given by (refer to equation 2.4.5). 


m-l n-1 

= Jo Jo 


(5.2.9) 


u*-' 

/kiQTQ y- n is the (k,l)-th entry of the output signal and 

ix. f JU 

X. . is the (i,j)-th entry of the input si. gnal, denotes 

subtraction operation in the mixed-radix number system with 
the invariants of group as mixed radices and denotes 
subtraction operation in the mixed-radix number system with 
the invariants of group G 2 as the mixed radices. 


/ 

/ 


In view of equation (5*2.8), the generalized convolu- 
tional relationship given by equation (5.2.9) may be written 
as 


^k,l 


“f X, 


i=0 j=0 


J 


/ 


jCQi** (X) _ X. ^ ilMM' • 

i.e., 


( 5 . 2 . 10 ) 


Equation (5,2.10) shows that the 2-1) convolution represented 
by equation (5.2,9) may equivalently be obtained through 1-D 
convolutions. In other words, the output y may be obtained 
in two steps ;(i) convolving s^ with each one of the rows 



of X to get a partially filtered output 2- D signal y, and 
(ii) tiwm convolving each column of y with to get the 

final filtered output y. 

The steps outlined above lead to the exa ct sample 
domain implementation of a separable 2-D P-I filter. It is 
clear that unless the input signal size, i.e. , m x n is small 
the storage requirements and the computational effort invol- 
ved would be considerable. However, approximate implementa- 
tions ^ involving reasonable storage and computational time 
requirements which give good approximations to the desired 

transfer characteristics, are possible, Por example, the 

1 2 

desired ideal transfer characteristic vectors S and S may 

each be approximated in the least-squares sense. For the 

case when S is a zero phase transfer characteristic, if Sj^ 

of length m and s- of length n are the unit sample response 

1 2 

vectors corresponding to S and S respectively, then such a 

1 2 

least-squares approximation of S and S .can be obtained by 
retaining only say p entries of s^ and q entries of s^ 
such that p <m and q <n' 

To illustrate the implementation scheme outlined above 
for the separable 2-D P-I filters, we consider two filtering 
examples, one in the Fourier domain and the other in the 


Walsh domain. 
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• A low pass zero phase cyclic 2-D P-l filter 

with m = 48, n a 48 and specified ideal rectangular transfer 

characteristics having cutoff frequencies k = 10 and 

c 

1^ = 10 is to be implemented. Pass band amplitude response 
= 1.0 and stop band amplitude response is zero. 

We shall use least-sequares approximation by using an 
8-term approximation for each of the sample response vectors 
s^ and Sg • 'These 8 sample response coefficients to be 
used have boon computed and are given in Table 5.1. 

Table 5.1: ici epf s_ 1 


i 

4 

s^ and 

0 

0.59585 

1 

0.50165 

2 

0.09716 

3 

- 0.05933 

4 

- 0.07775 

5 

- 0.00424 

6 

0. 05030 

7 

O.O 51 O 6 



Entries of the approximate transfer characteristics of the 
1— D cyclic P— I systems and H 2 obtained under the 8— term 
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approximation of the sample response vectors s^ and 32 ' , 
are tabulated in Table 5.2. In this table, only the first 
24 entries are shown because of the even symmetry of the 
transfer characteristics and . 


Table 5.2: Entrie s, of the Approximate Tr ansfer Characte- 

J[§SiQrs_qf ^ and , H2 in_Bxample_5 .2,1 


i 

q1 . - , 

i 

, sl 

0 

1.07350 

12 

0.05459 

1 

1.03957 

13 

0.06738 

2 

0.96691 

14 

0.02206 

3 

0,91991 

15 

0.02067 

4 

0.94615 

16 

0. 02990 

5 

1.03398 

17 

0. 01178 

6 

1.11173 

18 

-O.OO9O6 

7 

1.09089 

19 

-0,01464 

8 

0.92412 

20 

-0.00584 

9 

0.63843 

21 

0.00432 

10 

0.32164 

22 

0.00584 

11 

0.07204 

23 

0.00043 


The realized transfer characteristics of the 2-D cyclic P-I 
filter are shown in Fig. 5.3. 
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^'ig. 5-5 5 Realized ijmplitude Characteristics of 
the vii®#- Cyclic 2-1) P-I Filter in 
Example 5.2,1. 


* 

1,13 

B 

0.89 

1 

0.59 

w 

1, OG 

J 

0. 79 

+ 

0.09 

z 

0.99 

0 

0.59 

... ,'. 

-0,04 
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ExamE,! .S.2 s A dyadic 2-D P-I filter with m = n = 32 and 
specified ideal rectangular amplitude characteristics having 
cutoff sequencies = 7 and 1^ = 15 is to he implemented. 

The pass hand amplitude response is 1.0 and stop hand amplitude 
response is zero. 

Least-squares approximation is obtained with 8-term 
sample response vectors s^ and s^ for the l-L P-I systems 
and Hg. The entries of s^ and Sg are tabulated in 
Tahlo 5.3. 

Table 5 . 3 : ^i!P.M.Jlf.aPah§^.^ 2 ,§fliciejits^,.in,,^^ 


i 



0 

0.46875 

0.21875 

1 

0.46875 

0.21875 

2 

0.03125 

0.21875 

3 

0.03125 

0.21875 

4 

- 0.03125 

0.03125 

5 

- 0.03125 

0, 03125 

6 

0,03125 

0.03125 

7 

0.03125 

0.03125 


The realized transfer characteristics for this 2-1) dyadic 
filter are shown in Pig. 5.4. 
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Pig, 5*4* Realized Amplitude Characit eristics 
of the I^radic 2-D P-I Filter in 
Example 5*2.2. 


* 

1.13 

C 

0.59 

¥ 

1.00 

I 

0.39 

Z 

0,99 

+ 

0.09 

B 

0.89 

- 

-0.04 

E 

0.79 
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5.3 

Separability of a 2~D P-I system (see definition 
5.2*1) may equivalently be stated in terms of the rank of 
its transfer characteristics matrix or its unit response 
matrix. It may be recalled [ 41,p.92] that a matrix S of 
size m X n is cxprcvssible in the form 

S = (S^)^ 

1 2 

where, S"^ nnd S are column vectors of sizes m x 1 and 
n X 1 respectivoly, if and only if S is of rank 1. Then, in 
view of the definition of separability and theorem 5.2.1 it 
follows that a 2-D filter is separable if and only if the 
ranks of its unit response matrix as well as its transfer 
characteristics matrix are 1. The observation is often 
helpful in determining whether the desired filter is directly 
realizable in separable form or not. As an example, consider 
the ideal rectangular characteristics shown in Figs. 5.1 and 
5.2 in which we assume that the response is 1 in the pass 
band and zero in the stop band. Inspection of the rows of 
these characteristics reveals that there is only one linearly 
independent row in each of them. It, therefore, follows they 
are both of the separable type. In contrast, it may be veri- 
fied that the ideal circularly symmetric loi^ass transfer 
characteristics are not separable, there being more than 1 
linearly independent rows in such characteristics. 



A filter which is not by itself in a separable form 
may, as a compromise, be realized as a linear combination of 
several separable filters. This possibility is based on the 
following result [41 ,p.93] concerning transformations on 
finite dimensional vector spaces: 

le mma 5.3.1 : If A is a linear transformation of rank k on a 
finite dimensional vector apace, then A may be written as the 
sum of k transformations of rank one. 

i^'rom this lermna, it immediately follows that if the 
rank of the specified unit response matrix of a 2 -D filter is, 
say, k, then it can be realized as a cascade of k stages of 
separable filters since its xmit response matrix can be written 
as 

S = «! Si + a2 S2 + 

In this expression, is the response matrix of the i-th 
separable filter expressible in the form 

Such a realization of a 2-1 P-I filter may be seen to be the 
P-I counterpart of the multistage separable realization of 
ITI digital filters proposed by Shanks and Treitel [7]. 


CHAPTER 6 


IMPLEMEITATION OP 2-D P-I SYSTEI4S 
IE TERMS OP THEIR EQUIYALEHT 1-D P-I SYSTEMS 

In Chapter 5 the problem of applying 1-D techniques to 
the filtering of* finite discrete 2-D data was considered in 
terms of the r. oecial case wherein the specified 2-D transfer 
characteristic i wG:i.‘e separable. In this chapter, we adopt a ^ 
different approach to the problem. To be specific, we consider 
hero a method of 1-D implementation of 2-D P-I filters which is 
based on the results obtained in Chapter 3 pertaining to the 
equivalence between 2-D and 1-D P-I systems. This method per- 
mits the use of 1-D techniques for 2-D tasks irrespective of 
whether the specified 2-D transfer characteristics are separa- 
ble or not. As shown here the exact 1-D equivalent of a dyadic 
2-D P-I system is again a dyadic P-I system while the exact. 

1-D equivalent of a cyclic 2-D P-I system is cyclic provided 
a minor restriction on the frame size of the pertinent 2-D 
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signal array is satisfiod. Thus, this method is particu- 
larly suitablr' in doaliiig with problems concerning filtering 
of f inatc dxBoroto 2*— 33 data in the iPourier and Walsh domains, 
especially, when the specified 2-D transfer characteristics • 
are not separable. In view of this, only cyclic and dyadic 
classes of P-I systems are considered in this chapter. 

Given a 2-D P-I system T on V, the space of real m x n 
matrices, in order to obtain its 1-D equivalent^ we need to 
use an appropriate linear transformation Q; 7 -+ or equiva- 
lently, an appropriate index mapping f: x -»■ Z^^, I = m.n. 

The choice of tho index mapping has to take into account the 
composition of tho group G relative to which the equivalent 

1- D P-I system is defined. It may be noted here that the 
choice of the index mapping determines only the structure of 
the permutation matrices constituting the , group G but not the 
composition of this (group. The composition of the group G is 
governed by the fact that G is isomorphic to the direct pro- 
duct of G^^ and G 2 (refer to ^eorem 3.3»1 ) w-here G^ and G 2 
constitute tho pair of groups relative to which the given 

2- D P-I system has been defined. We examine the nature of 
those direct product groups separately for the two specific 
cases wherein the two groups G^ and G 2 are (i) cyclic, and 
(ii) dyadic. We first take up the case of cyoliG filters in 
the following section. 
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6 • 1 JjSLEiSiQSU tOs tiOJi -Q-t Q.vo lio _,S.y s 1; eifl. Through. 

i ts 1 >».D Equivale n t 

Filtorin;? of finite discrete 2-D data in the Fourier 
domain corroaponda to cyclic 2«D P-I filtering. This means 
that the 2~D filter required to perform filtering in this 
domain will be permutation invariant relative to two cyclic 
groups and Gg* Therefore, its 1-D equivalent will he 
permutation-invariant relative to a group of permutation 
matrices G which is isomorphic to the direct product of two 
cyclic groups and Gg* will now examine the composition 
of this direct product group. 

6.1,1 Direct Product o f Cyclic Groups 

A standard result in group theory [29, p.l2] is that 
a direct product x H2 x ... x of cyclic groups is cyclic 
if and only if their orders {h^} are powers of distinct 
primes. 

V/hen this result is applied to the problem of obtaining 
the 1-D equivalent t of a 2-D P-I system T on V, it follows 
that the group G relative to which t is permutation-invariant, 
is a cyclic group iff m and n which are respectively the 
orders of the two cyclic groups G^ and G2 (relative to which 
T is defined), are relatively prime. Since m and n also 
represent respectively, the number of rows and columns of 



the arrays in the signal space 7 of T, it follows that 

IhifiXSra i '-P bo a 2-D cyclic P-I system, then its 

equivalent 1-D system t is a P-I system belonging to a cyclic 
class iff the number of rows m and the number of columns n 
of the pertinent input signals of T are relatively prime. 

Thus, two oases arise depending upon whether m and n 
are relatively prime or not. We will now consider the impli- 
cations oC each ono of these cases with reference to our 
ultimate ob.jcctivc of implementing a 2-D cyclic P-I system 
in terms of its equivalent l-P P-I system. 

'i''* 

a. Referring to TRieorem 

6,1*1 wo know that in this case the equivalent 1-D 
P-I system is not a cyclic one. This means that the 
well established design procedures available for 
cyclic convolutional systems cannot be made use of 
for this equivalent 1-D P-I system. So, we will not 
discuss this case any further. 

■this ssse the equiva- 
lent 1-D P-I system is cyclic making it possible to 
roly on the well developed design techniques available 
for cyclic convolutional systems. Further, a specified 
transfer function of a 2-D cyclic P-I system which 
involves two frequency variables, can in this case be 
reduced with the help of a suitable one-to-one index 
mapping fi x Z^, into a transfer function 

involving only one frequency variable, the resulting 
transfer function being that of the equivalent 1-D 
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P-I syatem obtained under the index mapping f. 
Moreover, the condition that m, the number of rows, 
and n, tlic number of columns^ should be relatively 
prirno is, ini act, only a minor restriction on the 
frame size of the input signals. Since m and n 
need not themselves be prime numbers, a wide range 
of choice is still available for m and n and, if 
need be, they can be made almost eq.ual while keeping 
them mutually prime. Therefore, in our study of 
equivalent 1-D implementation of 2~D cyclic P-I 
sy.'itoms, we shall henceforth assume that m and n 
arc rolat Ively prime. 

6. 1. 2 MUvaiqrit . 2-D .Oxclic , P-J 

Sys tems 

As a first step in the implementation of a 2-D cyclic 
P-I system T in terms of its equivalent 1-D cyclic P-I system 
t, we now choose an appropriate one-to-one index mapping 
f: Zjjj X Zjj, If G be the cyclic group relative to which 

t is permutation- invariant, an appropriate index mapping 
for the cyclic case is chosen here by requiring that the 
matrix members of G, constructed as outlined in Chapter 3 
(refer to soation 3*2 ), get ordered according to increa- 

sing powers of the generator of G# As shown here, when the 
matrix members of G are ordered in this manner, they assume 
the form of cyclic permutation matrices with respect to the 
standard basis of so that the available theory of cyclic 
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convolutional systems can be directly applied to the equiva- 
lent 1-D cyclic P-I nystom. 

let fD be a i'—D cyclic P— I system relative to and G '2 

of orders m and n respectively, where m and n are relatively 

prime, let p and q denote the permutation matrices of size ■ ^ 

m X m and n x n respectively, that are the generators of G. 

1 

and Gfg- Since cyclic groups, with the usual 

scheme of ordering [App. A] members of transitive abelian per- 
mutation ,'p~oup:i, the i-th member of ieZ^^ is p^ and the 
J-th meinbt.T of Gg, is q^. If the system t is a 1-1 

equivalent of T obtained under a linear transformation Q: 

j\T 

V ■+ R then, as shown in Chapter 3, it is permutation- inva- 
riant relative to the cyclic group G of permutation matrices 
p^ P 1 0'S the generators of G^ 

and Gg roepoctivcly, the generator of the cyclic group G is 

p(x, q BO that if we order the matrix elements of G in the 
Q 

order of increasing powers of this generator, the k-th ele- 
ment of G is given by P. = (p^^ q)^. Now, if the one-to-one 

K V..Q 

index mapping f associated with the linear transformation Q 
( - remark 3.1.1 ) niaps the pair of integers (i,o) into 

the integer k, i.o., if 


f(i,j) = k I ieZ^, jeZ^, keZj^, 
then the elements of the group G will be ordered according 
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to increasing powers of its generator provided, the index 
mappin'i: f is nich that 


for every keZj, . (6.1.1) ^ 

From standard propcrtios of Kronecker product of matrices, / I, 

(P ?„ '1^*' = I*' - (6.1.2) ^ i 

H Q -I 


But p is the ■renerntor of the cyclic group of order m so that 
p“ = where if! tho iii x m identity matrix. Similarly, 

=s v/!jt:rc: 1^^ ic tho n x n identity matrix. Therefore, 


with keE|^ whuru N ra.n, oquation (6,1.2) 
(p(x = Cp q “) 


may be rewritten as 



where (J^)^ donotofs the residue of Ji modulo r. Thus, equation 
(6.1,1) becomi'8 



for every keZ^ * 

(6.1,3) 




In other words, the index mapping f should be such that 
oquation (6,1,3) is true for every keZjj. For such an index 
flapping 

f (i»3 ) * k 

k a i mod m, and f (6,1.4 

k « j mod n ♦ 


Ve/A^-iVely 

Note that, since m and n are mwtaaiiy prime, the Chinese 
Remainder inieorcm (cRT) provides a unique solution for k 
in terms of i and j, Thus, this index mapping is one-to-one. 

J?his niappin-'^ f orders the matrix memhers of the group 
G (relative to which the equivalent 1-D system t is 
defined) according to increasing powers of its generator P 
so that the k-th member of this group denoted by P, is given 
by 

P. =s fxN cs 

(j > 

where- is the order od pair of integers mapped onto k 

by f. 

Next we show that the matrix members of G assume the ^ 
form of cyclic permutation matrices when this index mapping 
is used. For this purpose all that wo need to show is that 
the generator P of G is a cyclic permutation matrix which has 
a 1 only in the (r + li^th row and r~th column position for 
any reZjjj. This follows from the fact that this index mapping 
orders momboi's of G according to increasing powers of its 
generator P. First let us consider the zeroth row of P sepa- 
rately, This corresponds to r = N~1 so that this row should 
have a 1 only in the (N*l)«th column position. To see that 
it is indeed so, recall the way the matrix members of G are 
constructed, Tha zeroth row of P denoted by P^^^ is obtained 



by taking the Krone oker product of the zeroth row of p, the 
generator of nnd the zeroth row of q, the generator of 
treating these row vectors as (l x m) and (l x n) matrices. 
Therefore, 

T.(0) (0) S (0) 

^ = p h?; r ' (6.1.5) 

where and are the zeroth rows of the cyclic matri- 

ces p and q. From the properties of cyclic permutation 

fn'i 

matrioos, wo know that p^^^ has a 1 only in the (m-l)-th 
column posit ion and zeros everywhere else, and that has 
a 1 only in the {n-l)-th column position. Then, from (6.1.5) 
it follows that will havealonly in tho u-th column 

position where u = f((ra-l), (n-l)). This means that u is 
the unique aolution of the simultaneous congruences 

u s (ra-l) mod 

and u = (n-l) mod n. 

It is easy to verify that u = (N-l), where I = m.n, is a 
solution of these simultaneous congruences because 
( (N«l)«(m-l) ) is divisible by m and ( (N-l)-(n-l) ) is divi- 
sible Jfty n* Since m and n are mutually prime, the above 
simultaneous congruences have a unique solution and there- 
fore, u = (N-l) is that solution. Thus, the zeroth row of 
P has a 1 in the ( N-l )-th column position and nowhere else. 
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To oXcimino bho S'tmc’tu.ro of ’fch.o o’bh.GZ’ rows of P* con- 
sider in general the v-th row of P whore, 1 < v < (F-l). if 
P is a cyclic permutation matrix, its v-th row should have a 
1 only in the (v~l)-th column position, let 

f**^(v) = (i,j) 

so that 

i =s (v) and 

. , , ( 6 - 1 - 6 ) 
3 = Mn . 

Ihon, (6.1.7) 

(v) 

whore ivC the v-th row of P, and p and q are 

respectively the (v) «th and (v) -th rows of p and q. Since 
((v) ) 

p hae a 1 only in the ((v) ~l)-th column position and 

((v) ) 

q haa a 1 only in the ((v)^-l)-th column position, 

■^en from equation (6.1,7) it follows that will have a 

1 in the w-th position and zeros elsewhere, where 

w« (((v)^-l), ((v)^-!)). (6.1.8) 

But from equation (6,1*6) we have 

V = (i, j) a ((v)jjj, (V)^) , 

so that 

(v-1) =s ((v-l)^, (v-l)n^ “ {((v)j^-l) » ((v)^-l)) = w^ 
i. e, , w s* (v-l) , 
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Thus, the v-th row, 1 1 v < (N-l), of ? viz, , p(v) 
have a 1 in the (v-D-th column position and zeros elsewhere. 
Therefore,?, the generator of G is a If 5? N cyclic permuta- 
tion matrix of the form 

j~" '*-rj 

I 0 0 0 1 j 

I X 0 i ♦ * # * t * * * , ^ , 0 0 1 

% j 

^ 0 1 • » « * ♦ t # # • i t ■# 0 ' 0 ' 

I ^ 

I 0 0 1 1. 0 0 ^ 

s! * • • • ‘ 

i • * mm 

] 0 0 1 0 . 

i 

I ♦ 

i — «— » 

With the c^en orator P assuming this form, all the other mem- 
bers of Cx also asnuinc the form of cyclic permutation matrices 
since they are powors of this generator. Thus, when an indest 
mapping of thn form (6.1.4) is used, the o,yclic group G of 
permutation matrices has its members ordered according to 
increasing powers of its generator and further, all the mem- 
bers of G assume the form of cyclic permutation matrices. 

Having ohoson an appropriate index mapping, we shall 

next see how the transfer characteristics of the equivalent 

1~P system can be obtained from the specified 2-D transfer 

characteristics, It may be recalled from Chapter 4 (remark 

(l) 

4.2*2) that the tronsfer characteristics vector S of an 
equivalent 1-D P-I system is related to the transfer chara- 
cteristics array of the 2-P P-I system by the relation 
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where Q is the linear tranaf ormation which is used for obtai- 
ning the equivalent 1-D system. This equivalently means that 
the entries of viz., keZj^ may be written down 

from the entries of viz., , ieZ , jeZ using the 

relation 

=» , where (i,j) = 

f being the one-to-one index mapping associated with the ^ 

transformation Q (remark 3.1.1). which is the k-th 

eigenvalue of the equivalent 1-D P-I system, is associated 
with the k-tb eigenvector of t given by 

Hn ” ‘^(hj^(h^) ) s * 

At this stage, a point about the frequency ordering of the 
eigenvectors ought to be noted. In the case of cyclic P-I 
systems with wiiich wo are concerned in this section, the 

I'T ■ ■ 

eigenvectors will not in general be obtained in the 
natural frequency order for values of k equal to 0,1,2,..., 

(N-l) in that order. When the index mapping described by 
equation (6,1,4) is used for obtaining the equivalent 1-D 
system t, the frequency, p, of the k-th eigenvector of t is 
given by the formula [32,33]. 

V,^ 

p« (rai + nj)modH i 0 < p < N ? N = m.n ; (6.1.9) 

7 
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It; in&y Id© msii'tioiiGd. hs^r© "th.o.'fc "ths nisipping of indicss givsn 
by (6.1*4) and the frequency mapping given by equation 
(6,1.9) have been in use in connection with the multidimen- 
sional formulation of :,?T C: 52 , 55 ]We are using them here in 
the converse role for the purpose of obtaining 1-D implemen- 
tation of a given 2-D cyclic P-I filter. 

The 2-D requirements, given in the form of 2-D trans- 
fer charact eristics, may now be translated into corresponding 
1-D requirements in the form of 1-D transfer characteristics 
in the natural freqtioncy order. When in this form, the trans- 
fer characteristics are called here as frequency ordered 1-D 
transfer charact eristics, A 1-D cyclic P-I filter with its 
transfer characteristics approximating those of the frequency 
ordered 1-D transfer characteristics which are obtained from 
the specified 2-D characteristics may now be implemented using 
a suitable approximation technique* Per the purpose of illu- 
strating the equivalent 1-D implementation of a given 2-D 
cyclic P-I filter, we now consider the following example in 
which for convenience we use the least-squares approximation 
technique^ 

A zero phase 2-D cyclic P-I filter with input 
signals of frame size 51 x 49 and specified circularly symme- 
tric ideal low pass iJxansfer characteristics as shown in 
Fig. 6,1 is to be implemented, ^ , 
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Pig. 6.1; Specified JUnplitude Characteristics of the 
2»r) P-I Filter in Example 6.1.1. 
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This 2-D filter is implemented in terms of its 1-D 
equivalent under a linear transformation Q; ? -*■ corres- 
ponding to an index mapping of the form given by equation 
(6.1.4) using the values m = 51 and n = 49, As a first step, 
the frequency ordered transfer characteristics vector of its 

1- D equivalent under Q is obtained from the specified ideal 

2- D transfer characteristics, using the frequency relation- 
ship given by equation (6,1.9). The unit sample response 
vector of a 1-D cyclic P-I filter of length 51 x 49 = 2499, 
which approxi?Tiatea this ideal frequency ordered 1-D transfer 
character lotica vector in the least squares sense, is then 
obtained by rotaining only the first 312 terms of the inverse 
DPT of the ideal frequency ordered transfer characteristics 
vector and asr.iiiiiing zeros for the rest, keeping its even 
symmetry in mind [ 1 ]. Sample domain implementation of the 
equivalent 1-D cyclic P-I filter then consists of cyclically 
convolving this unit sample response vector with the equiva- 
lent 1-D signal obtained from a given 2-D input signal under 
the transformation Q. Finally, the filtered version of the 
given 2-D input signal is obtained by using the inverse 
transformation Q*“^. The given 2-D P-I filter has been imple- 
mented using this procedure and the realized 2-D transfer 
characteristics are shown in Pig. 6.2, The entries of the 
unit sample response of the equivalent 1-D system are not 
tabulated here in view of the large number of terms involved. 
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Fig, 6,2 

* 1.13 

W 1. 00 

2 0,99 


Eealizect Amplitude Charaot eristics of 
the Oyolic 2-D F-1 Filter of Example 6.1,1. 

B 0,89 I 0,39 

E 0,79 t -0.09 

0 0,59 - -0.04 
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In "bliG next GxamplGj tf© iinplemej^'b a, 2— D cyclic P— I 
notch filter. The equivalent 1-D cyclic P-I filter is in 
this case implemented as a recursive digital filter designed 
to have the appropriate transfer characteristics. 


* A 2—D P~.T notch filter with input signals of 
frame sizic 1^ x 14 is to he implemented. Its amplitude 
response is to bo 2:ero at frequencies (8,7) and (5,7) and 
unity eloowPorc. 


Lot t ’h; tliu 1-J) equivalent of the desired 2-D cyclic 
P-I notch filter under a linear trauBf ormation Q that corres- 
ponds to an index mapping of the form given by equation 
(6.1,4). ’7 g first obtain the frequency ordered amplitude 

response characteristics of t from the specified 2-D require- 
ments by using the frequency formula given in equation 
(6.1.9). In these frequency ordered response characteristics 
the ssero response frequencies are thus found to be 21 and 161 
corresponding respectively to the zero response frequencies 
(8,7) and (5,7) specified for the 2-D filter. These ideal 
frequency ordered amplitude characteristics of t, the equiva- 
lent 1-D cyclic P-I filter, are then approximated by a trans- 
fer function of the following form: 


^0 ^ 1 ^"^ ^ ^”0 
1 + + bo z 

JL ' . ^ 



( 6 . 1 . 10 ) 




H(2) 
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Here, the coefficients ag, a^, and b 2 are so chosen that 
the polos of H(Z) are withfcn the unit circle, and in addition, 
the amplitude response is zero at a frequency of 21, and is 
unity at frequoncies 0 and 91» Coefficient values determined 
on this basis aro given below: 

aQ = 0.599561 

=- 0.8986220 
=-.0,898045 
bg = 0.1994225. 

If H(Z) in equation (6.1.10) is interpreted as the transfer 
function of n. (l lyltal filter, tins sainple domain description 
of this filter is then 

y(n) + bj_y(n'-l) + b 2 y(n- 2 ) = 

aQx(n) + a2x{n-l) + aQx(n-2), (6.1.11) 

with x(n) and y(n) denoting the n-th input and output 
samples respectively. 

The steady fitate output of tlds digital filter for 
a periodic input of 182 samples per period, is the same as 
that of the cyclic P»I filter, t, whose transfer function 
is represented by equation (6,1.10), the input signal vector 
to the cyclic P-I filter being constituted by the 182 
samples in one period of the input sequence given to the 
digital filter. 
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This fact was utilized for computer simulation and 
the 1"D P~ I f iluornig was carried out hy implementing the 
recursive algorithm (6.1,11) of the digital filter, the 
input fed to it Ijoing that sequence whose one period was i 

the 1-D equivalent of the 2-D finite discrete signal which i 

was to he filtered# It may he noted that this approach of 
simulation provides a link between the theories of 'l-D 
digital filters (characterized hy linear convolutions) and 
cyclic P-I filters. , 

For thip .implomentation,^2~D finite discrete signal 
which is to hi; filtered, is taken to be the sum of two 
components «• a desired signal and a noise signal. 

These are givcMi by 

= Sin (fl 1 + 'll J) ! i=Zi3 ! ^ 

and = Sin (“£|— i + 7t j) ? ieZ^^ J 

The noise si,!paal X^, a double sinusoid corresponding to the 
specified notch frequency for the 2-D filter, is eliminated 
in the output. In Pig. 6,3» (a) and (h) show respectively 
the first row and first column of the 2-D input signal while 
(c) and (d) show respectively the first row and first column 
of the output 2-D signal. 
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6.2 Implmcnt ation of g I^ad io 2 ~P P-l System 

Thrguiih „iXs J,gulv^ 

Piltorin," of finite discrete 2-D data in the Walsh 
domain corresponds to dyadic 2-D P-I filtering. In other 
words, a 2~D filter required to perform filtering in this 
domain is pormut at ion-invariant relative to two dyadic 
groups 0^ and Og, ®ion, from the results in Chapter 5 we 
know that its l-D cniuivalent is permutation- invariant rela- 
tive to a group of permutation matrices C which is isomorphic 
to the direct product of the two dyadic groups and 62* 
shall now examine the nat\ire of this direct product group. 


6.2.1 Di^CT^^ to,djy,c t_qf 


It is known that a fproup with invariants m^, a-eZ^, 
is isomorphic to the direct product of r^ cyclic groups gQ, 

with invariants mQ, m^, .../ , “r -1 


Si 


> * t • ♦ I fe'w 


1”"* '' '•I 

tively. How, if we asaiome G^ to he a dyadic group of order 


* 1 

2 , we 


know that its invariants m„,aeZ are each equal to 2. 

“ ^1 


Therefore, 


Gj^^ — gQ X gji^ X g2 ^ ...» X 


( 6 . 2 . 1 ) > 


In equation (6,2.1), the symbol * is used to mean 'is iso- 
morphic to’, and cyclic groups, each of 

order 2, But then a cyclic group of order 2 is isomorphic to 
a dyadic group of order 2. Therefore, 
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^1 “ ^2 ^ ^2 ^ ^ ^2 ^^1 factors) ^ (6,2,2) 

where Dg in a dyadic group of order 2. 

Now, if' (>2 is a dyadic .group of order 2 2, it can be 
expressed according to equation (6.2,2) as the direct pro- 
duct of r 2 dyadic groups each of order 2. It then follows 

that the direct product of a, and is a dyadic group of 

ri+rg j. ^ 

order 2 , Hence wo make the following remarks: 

The direct product of dyadic groups is dyadic. 

Remark- 6, 2, 2; Unlike the cyclic case, here there is no res- 
triction on tfio orders of G^ and Gg for their direct product 
to be a dyadic ,gronp. Hence, for convenience, we shall assume 
both of io have the order n. This equivalently means 

that the signal arrays for the 2-D dyadic P-I systems are 
assumed to have n rows and n columns. 

6,2.2 Equiv alen t 1-D Implementation q|h.2-5_l5ya^c.„P-I 

.ays-t-ems 

It follows from remark 6,2,1 that if T is a 2-D dyadic 
P-I system, then its equivalent 1-D system t is also a dyadic 
P-I system. Now, to choose an appropriate index mapping in 
this case, we follow a procedure which is essentially the 
same as the one we adopted for the oyolic case. Thus, we 
require the index mapping in the present case to be such 
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that the matrix members of the dyadic group G, relative to 
which thc3 GQ^uivalGut 1”“D system is pcrmutatiou^iuvariaiitj 
assume the standard form of dyadic permutation matrices with 
respect to the standard basis in R = r?. With members 
of G in this form, it will be possible to directly apply the 
existing theory of dyadic convolution systems for the design 
and implementation of the eQ.uivalent 1— D dyadic system. 
Following a procedure similar to the one used in the cyclic 
case, wo conclude idiat the index mapping we are seeking in 
the present o.usc is tlie one corresponding to the familiar 
lex.ioo/craoiiic orciorinr': of pairs of indices, i.e., 

f(i,j) != k= (ni + 3) } i,3eZ^, N = n^, keZj^* 

( 6 . 2 , 3 ) 

Now, using a linear transformation Q which corresponds 
to this index mappin,.;, it is possible to obtain the 1-D 
equivalent, t, of a given 2-.D dyadic P-I system T, when the 
latter is specified in the sample domain. But if the 2-1). P-I 
system is specified in terms of its transfer characteristics, it 
ia necessary to obtain corresponding specifications for the 
equivalent 1-D system. The transfer characteristics of the 
equivalent 1-D system may be obtained by the relation (refer 
to remark 4*2,2) 

= Q 


(6.2.4) ^ 
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where denotes the transfer characteristics vector of 

the equivalent 1-D systora and denotes the specified 

transfer charactoristios matrix of the 2--D P-I system. 

As was pointed out in section 6.1.2 in connection with 
the 1~D implementation of 2-D cyclic P-I filters, the transfer 
characteristics vector of the equivalent 1-P system obtained 
through equation (6.2,4) will not in general be sequency 
ordered. As pointed out there, if f(i, 3 ) = k where f is the 
index mapping given by equation (6.2.3), then, in order to 
arrive at the sequency ordered transfer characteristic of the 
equivalont 1-D systom, what wo need to know is the sequency 
value corroGporu'ing to this k. Wo examine this question in 
the followin.'S ooction. 


6.2.3 , § , gj ,u one v- Or d Iransfor Oha r acterist ics of t he 


Lot 


3(2) 


‘ ® 0,0 ^ 0,1 

■; ^ 1,0 ^ 1,1 



f Vl,0 Vi,l 

I 



^0,n-l 

^l,n-l 

4^ 


’^n-l,n-l ; 

. ^ J 


be the specified tranaCer characteristics matrix of T, a 2-D 
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dyadic P-I syntora. Since wo arc considering a dyadic system, 

n must bo a power of 2, So let 

n = 2"^ ■ 

’ ( 6 . 2 . 5 ) 

whore r is some positive integer. let 

; ®0,o ®0,1 ^O.n-l 1 

_(2) _ i ®l,n-l 

S » « t 

i • * 

i * # ^ 

; °n-l,0 ®n-l,l Vl,n^l j 

I 

be the unit iH-ijpu.ujc matrix of T. Then 

q( 2) „ ^k,i (2) . 7 , - . 

®i,j ? k,leZ^/6.2.6) 

Imc 4 

where h^* ,1.a the {k,i)-«th eloraont of the n-th order Hadamard 

matrix (soquoncy ordered) and ,p.von by 

h^»^ = n (-1) “ a + 1 (6.2.7) 

OSaO 


Hero, kp and i^ arc digits in tho bingory expansion of the 
integers k and i respect ivoly, 

let denote the sequency ordered transfer chara- 

cteristics vector of the equivalent 1-.I) system obtained under 
a transformation Q oorrosponding to the index mapping given 
by equation (6.2.'d). Then its m-th entry is given by 
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S, 


( 1 ) 


m 


Jo "p 


meN 


( 6 . 2 . 8 ) 


Here, is the (m,p)-.th element of the H-th order Hadamard 

matrix (sequoncy ordered), and is given by 




P=0 


( 6 . 2 . 9 ) 


How, let 

f"^(p) = (i,j) 

I ( 6 . 2 . 10 ) 

and f"^(m) = (t,u) j ^ 

where f is the index m,ippin-; given by conation (6.2,3). 

Since f is a lexicographic mapping, (i,3) and (t,u) are the 
representations oi p .aid m respectively, with respect to the 
fixed radix n. i'hc binary ropresent.:'.tion of p is therefore 
obtained by concatenating the binary representations of i and j, 


^^2r~2* ^r-l» ^r-2» **** » ^ 0 ^ ~ 


^^r«l' ^r-2> *••• ' ^0' ^r-l' ^r-2» 


Oq) 

( 6 , 2 . 11 ) 


Hence, from equations (6,2.9) and (6,2,10) we havej 
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hS’P= (.l)“2r-l-P<Pp +Pp+i) 

PrsO ^ ^ 

( + Pp^.l) 

P=o > 

= { (_i)” 23>-1^®0 + Pl)_ (_i)“‘2iw2(Pl + Pj) 

^ • # a 

(_l)“2r-l-(r-l)(Pr-l + Pi.) } 

IK 

^ (-1) 2r-l-r^Pr Pr+l)^ (_3_j™2i^l.. (r+l)^Pr+l'*'P; 
(_l)“2r-l-(2r-l)tP2r-l)}_ 

Usin;: equation (6.2.10), 

hg,P = {(-i)“2r-l(Jo + 3i)_ * 32) 

(_l)‘V'3r-l + io)} ^ 

{ (_3_)“r-l(3.o + ii)_ (_3^)“r-2(il + 

(-1) ° ^'^ }. (6.2.12) 

Writing liown the binary representation of m (refer to equation 

(6.2,10)), 
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^2r™l » • • > m ) 




^0» ^r-l» \,2» > \) , (6.2.13) 


Replacing tlio m's in equation (6.2.12) by f 
usins equation (6.2.13), 


s and u's by 


■uHl f p 


• # • • • f 

+ io^ } ^ 

(.l)V2fil + i2)_ i^_ 


<!r*****X { i 4* 1 ) 

i n (-1) ^a+r i 

A J Z 


{ j (-1)^^ 


Using equation (6.2.7), wo 


may then write 


um,p 


(b.'*^»0 




(6.2.14) 


Substituting for 


.jjj-'-" in equation (6.2.8), 


L ‘'S’" ”t “f 


i=0 j=0 


u ‘^1,2 ^^n 


(6.2.15) 
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How, two separate eases arise dopendi 


even or odd, 


w.pon whether t is 


iXLSycn: Since t is, oven, = 0 so that fn,. , 

'0 “ chat Xor all such m's 


for which t ia oven, equation (6.2.15) mav be written as 


g(l) ^ "-1 h-1 


Thus, when m with a (loxioosraphio) 

such that t to cvcJi, 


^representation (t,u) is 


’"(t,u) 

U 

id) ^ q(2) 

W ■” ‘^u,t ' 

(e 

i.2.17) 

i-is ..£,4(1 : Sine 

may bo written 

a t 

as 

io odd, tg - 1. 

Therefore equation 

(6.2.15) 

1) 

m 

n-1 

iJo 

y 

jsrO ^ 

(.1)^0 


= 

n-1 

I 

i=s0 

Y h^-" s(n 



Since i i,g even 

or odd depending upon whether i^ is zero or 1, 

- 

m 

n-1 

Jn 

i=0 

j£o ^ i.d 

h*'t-l)^ 



n-1 

I 

iSO 

h^'" s(2) 

jlo ^ 1>3 

^t,3 ti,(n-l)_ 
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In writinj tho last stop of the above equation, use is made 
of tlH,.' lacl th-ii.t the.' (n—l) column in the soquency ordered 
Hadamard iii.atrix 11^, has +1 in oven rows and -1 in odd rows. So, 

/ •» \ 33.*^ X 33*^X ^ \ 


n n 


i,j n 


. 0 ,,+ >,i,u _ i,i,u C+) (n-l) . 

But h^ . hj^ - h^» w (in view ol equation A. 24, 

Appendix A) where, (+> demot 00 pointwisc binary addition. 

Sinoo wo h.avc 

ur+)(n-l) = (n>«l) - u 


Hence, fo^’ t odd, wo have 


1 ) 

t,u) 


n-l) - u,t 


(6.2.18) 


Equations (6,2,17) and (6*2.18) which hold respectively for 

(1) 

the cases t oven and t odd, imply that , the sequency 
ordered transfer oharactoristics vector of the equivalent l-B 
dyadic P-I system (obtained by using the lexicographic index 
mapping given by equation (6.2. 5)) » is formed by reading off 
the entries of the specified 2-1) transfer characteristics 
matrix in tho manner indicated by the arrow heads inside 


this matrix. 
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f 


; i 

> 'r 

o 

o 

m 

^®0,l 

1 


? 

% 

i ^ 

‘^lyO 

'^1,1 

i y 


Ji 

: 

# 

f . 


* 

i • 


• 

^ • 

> r 

Vl,0 

Ss 

n-1 




s 


. s, 

❖ 


0, n-l 

1, n-l r 


.’ S 


n-l,n--l i 


With its soq’ucncy ordered transfer characteristics 


obtained In thin manner, the equivalent 1-D dyadic P-I system 
may now bo irnple'tm sited using a suitable approximation technique. 
¥g now give an t.xrufvplo to illustrate the implementation of 2-D 
dyadic P~.I filtor :Ui terms of its equivalent 1-D system. 


Ixamplo 6. 2, Is A S-D dyadic P-I filter with n = 32, having 
ideal ciroularly oyra;'!ctric low pass amplitude characteristics 
with a cutoff scquoncy of 15, ie to be implemented. Amplitude 
response is 1 in pass band and zero in s-top band. 

This 2-D dyadic P-I filtor is implemented in terms of 
its equivalent 1-D dyadic P-I system obtained by using the 
index mapping f given by equation (6,2. 3)» first, the sequency 
ordered transfer characteristics vector for this equivalent 
1-D system is obtained using the result obtained in section 
6.2,3, The equivalent 1-D system is then implemented using 
least-squares approximation technique [ij. For the purpose 
of this approximation, out of a total of 1024 entries, only 
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tho first 256 oiitrlns of tho unit ecaple response of tie 
equivalent 1-D filter are oonsidorod. The implementation of 
tho equivalent 1-D is carried out by dyadloally convolving 
this approximate unit response vector with the l-D equivalent 
(obtained through tho use of index mapping f) of the 2-D 
finite discrete si^jnal which was to be filtered. The 2-D 


version of tho output signal so obtained, is the desireci 
filtered output of the given 2-D P-I system. The realized 
transfer oharactcriatica of the 2-D filter are shown in 


Pig. 6.4. 
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Pig, 


*'^***H'^4‘’*** K 

W<^?7lhV«#^ft7W^W+«+«+-4-H--4-f~l -H-+ 

-+-+«4-+-s-+-f~<-+i 
#7#W7^^W^ir^(PC H-~f i4i+-M-H-^-i(-+- 

H^+~+-+-+-f-+-+-+- 

W^A7»7^^WHC«+-4-+-f-+.^H--•^•■-f-+ 
W4S7i«7€mfG-+-i--4-H--+^i+H--+-+-+ 
V/^#7/#?FJIC -^.-+-4 -+-+-i-+-+h-h— i- 

CCOO'O ****4' ^^4-**^4‘*“4‘‘^4**^*'**4'**4*^**^^^^ 

GGCCO 

OOOCO ^4 >i»4* **^4 n'i *»'|'' ** *'! * ^i*****^****}” * * "" I ' "" 1^'* w ' l ' " w*"*}*****^*^ 

CCCCC 


■«>i*«(«,|,, .«m«w|m **<*4* w *» » 'i )* ' *.«* *}' 

mmjji'i i!w»i i.n i| » m :4* ***4* ** 4 ' * 1 ”* ** * '‘ ' t" " ' > "*4 '* *' “{ ** * * " ‘ 1“ »*»»4» »ii#4* *** 4" ***4* 

»#*4* «i«4* **'*4* ** 4* «*4***4" •*4'* '**4* **4* ' m * '4 ****4****4* ^^^w****!" 


*4 ij#4**** *4'* ** 4 * ** **** 4* »<* 4***4 '**' * I* ' * 
4* W Wnlw **4* ' 





6,4J Realized iimplitude Characteristics 
of the 2-D Ijyadic P-I Filter in 
Example 6,2,1« 


* 

1 . 13 

C 

0.59 

w 

1.00 

I 

0.39 

2 

0,99 

+ 

0.09 

B 

0,89 


-0.04 

B 

0,79 





OHAPTSR 7 


P-I SYSTEMS 

ON FINITE FEEDS AND RINGS 

Our otiuly iian oo far been concerned with P-I systems 
on vector apacon ch'rined over the complex number field. In 
this chapter, wo propose to study (i) P-I systems on vector 
spaces dorinod over dinito fields and (ii) P-I systems on 

fin^S 

modules dorined over of residue class integers. For 

convenience, we nluill henceforth refer to these systems res- 
pectively a,j3 (i) P-I systems on finite fields, and (ii) P-I 
systems on rin^js* The input and output signals for P-I 
systems on finite fields are finite sequences with entries 
drawn from a finite field, while those for P-I systems on 
rings are finite sequences with entries drawn from a ring of 
residue class integers. The sample domain behaviour of these 
two new categories of P-I systems is dealt with briefly, 
covering only those aspects in which they differ from 1-D 
I*-! systems having real-field inputs. The main concern here, 
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is to study the no systems in tho transform domain. It is 
shown here that ju'it like tho 1-D P-I systems with real- 
field inputs, tliosc two catogorios of P-I systems also de- 
fine finite dincrote transforms. The transforms defined by 
cyclic class P-I systems on finite fields correspond to the 
'Fourier transform in finite fields' [ 15 ], and the trans- 

forms defined by cyclic class P-I systems on rings will, by 
an appropriatf; chcjlco of the modulus of the ring, lead to 
tho various nuuilior-ihoorctic transforms [ 16, 17 ] that have 
been proposed in the last fow years for efficient and error- 
froG computatloii of convolutions 


To bui'iin with, in section 7#1 wo deal with the minor 
modifications th.at art-' needed in the expressions for convolu- 
tions nocoacitatoe by the finite nature' of the underlying 

finite field or ring. In the next four sections, P-I systems 

pt&fiotii 

on finite Lielun arc studied in detail. Tho Isstt section, 
i.o. , section 7*6 is devoted to a study of P-I systems on 


rings . 


Oonvolu tio ns i,n Finite Fields__..a nd..AiS:;a§, 

It Is known tliat a cyclic P-I system in the complex 
number field performs a cyclic convolution doscribed by 
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where 0 denotos aubtraction modulo n. The symbols s, x^and 
y respcctlvoly denoto the unit sample response, the input and 
the output sequcfioea. IVhen we consider cyclic P-I systems on 
a finite field of characteristic p (see definition 7.2,3) 
where p is a prime number, the entries of the sequences s, x 
and y in equation 7.1.1 aro numbers of the field of integers 
modulo p. In the case of cyclic P-I systems on a ring of 
integers modulo p, where p is any integer, the entries of 
these soquoneca in equation 7.1.1» are from the ring of resi- 
due clasri integern modulo p. Henco, the cyolic convolution 
correspond inr; to hoth tlioac cases - cyclic P-I systems on a 
finite fiolda of oiiaractcristic p, and on the ring of residue 
class integer £1 modulo p, takes the form 


(Jo ® 




whore p is to be Interpreted as the characteristic of the 
underlying finite field in the ease of P-I systems on finite 
fields, and as the modulus of the underlying ring of residue 
class integers in the case of P-I systems on rings. Purther, 
the symbol’s’ donotos congruence. 
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Howovc-i'y i oi' {',1 cyclic P*~I sysioni TO.'fch. a given 
integer ncqucncc a aa its unit sample response, if it is 
known that the input integer sequence x is bounded by the 
value °o^Srueuco 7.1.2 is essentially an 

equality 

n-1 

" ilo ‘’i 

provided, Ihc. vniiu: of p is suitably chosen so that 

P > I ’'I max *|o l=ll . e.lh) 

In the above inequality, p has to be a prime number when the 
P-I system is on a finite field and it may be any suitable 
integer when the ays tern is on a ring of residue class 
integers. 

In general, a P~I system on a finite field or. on a ring 
of residue class intogors, defined relative to a transitive 
abelian group G of order n, denotes a convolution operation 
givon by equation (7. 1*2) but with the understanding that the 
symbol;'-^ now donotos pointwiso subtraction operation in the 
mixed-radix number system with the mixed-radices given by 
tho invariants of the group G, 



167 


7.2 


to .FUiT-An, -Mi. tiie_Pi^b],em^qf.^den^^^ 


In out* study of* P“I systems on finite fields in this 
and the next throe oeotions, certain standard results from 
the theory of finite fields will be made use of quite fre- 
quently. Hcncc, wo begin this section by listing a few of 
the useful definitions and theorems pertaining to this 
theory. 




Def in i t ion 7 . i 


Tilts order of^field is equal to the number 


of elementn in the field | if the order is finite, we call the 
field a finite field. 


Theorem .X i.S f l * Inttsgers modulo p, where p is a prime, form 
a finite field of order p. For example, the set of integers 
modulo 7» i.G,, { 0,1, 2,3,4»5»6 } forms a finite field of 

order 7. 


Theorem 7, 2. 2 ; If p is a prime and m is any positive integer, 
then there exists a finite field of order p“^. 

As an exaraplo, a finite field of order 2 - 4 is 

O 

formed by tho eleraonts 0,1, a, a , where a is defined by the 
relation: 1 + a =. a^. In general, if f(x) is an irreducible 
polynomial of degree m with its ooefficients in the field of 
integers mod p where p is a prime, then the residue classes 
mod f(x) form a finite field of order p“^. 
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Let a be a non-zero element of a finite 

field. Then tlu; loaet positive integer e f or 'which a® = i 

is called the orric.;r of the element a. for example, in <SS{2^) = 

2 

{ 0 ,l,oc., n } consltiorod in the previous example, the elem.ent 

a has an order 3 since ^ a. a =a(l + a) = 1 . The element 
2 

a also has the same order. 

Theor oi 4 finite field of order q .muot contain at 

least one i.'lt::uu;rit whicli in primitive ,i, e. , one whose order is 
(l-l) and whont' poworu include all the non-zero field elements. 

In t!u* rinito funld of order 5, viz,, {0,1, 2,3 , 4 } , 
formed by intugi.-rn modulo the prime 5 , the elements 2 and 3 
are primitive olomujitn and have an order 4 since 4 is the 
least positivo inltv'cr satisfying = 1 mo.d 5 and 3'^ = 1 mod 5. 
Further, 2 ^ 1 mod 5 , 2 ^ « 2 mod 5, 2 ^ = 4 mod 5, 2^ = 3 mod 5. 

Also, 3^ slmod 5, 3^ = 3 mod 5 , 3^ = 4 mod 5, and 3^ = 2 mod 5. 

..Defi nition 7.2.3: Thn least positive integer c, for which 
ca - 0 for ovory a of the field, is called the characteristic 
of the field. 

In the field of residue class integers mod p where p 
is a prime, the characteristic is p. 

5keo|‘era.Jj^4: In a field of characteristic p, the field 

integers form a subfiold of order p isomorphic to the field 
of integers modulo p. 
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Oonnidar for example, the field ^{ 2 ^) = {Ola a^ 

The field into -;, .to 0 and 1 form a aubfieia of 8 P( 2 ) and {0,1} 
is the field formed by the residue class integers modulo 2 . ' 


aoa3:em..ia.^: In a finito field of order 9 , the order of 
every element must divide (q- 1 ). lake for example ®( 2 +). 

It has an order q = 16, i.c., it has 16 elements. The oh^ra- 

cteristic 2, the fiold 

.f .» wiu xxLia intGjors are 0 and 1. if a be a 

primitive? filament of thia firld fhnn on -m-, 

wfixa .ij.c.xa, rnen all the non-zero field 

elements mnot ha nera ted by successive powers of a, viz., 

“ ' ® Collowiny table givos the orders of the 

various fit., id aiait.nntn. In this table, a is a root of the 
irreducible polynoailal + x + 1 , 


Table 7*1: 







S.Io. 

Plaid B trie try 

Bloraont Ha pre.-nen- 
tat Lon 

„ Order S.No. 

Pi eld Binary 
’Element Represen- 
tation 

1 

0 

0 

0 

0 

0 


6 

4 

0 

0 

1 

1 

2 

1 

0 

0 

0 

1 

“ 

7 


0 

1 

1 

0 

3 

a 

0 

0 

1 

0 

15 

8 


1 

1 

0 

0 

4 


0 

1 

0 

0 

15 

9 


1 

0 

1 

1 

5 


1 

0 

0 

0 

5 

10 


0 

1 

0 

1 








11 

9 

1 

0 

1 

0 


Order 


15 

3 

5 

15 

15 


5 
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Table 7*1 J (continuod) 


S, No, 

Field 

Element 

Binary 

Representation 

■m j) * , ■ A, ,;,*irvw*«— 

Order 

12 

10 

a 

0 111 

3 

13 

11 

CE 

1110 

15 

14 

a 

1111 

5 

15 

Hi 

110 1 

15 

16 

14 
a ^ 

100 1 

15 


7.2.1 lOjia t i temm JJsM ' 

An oli-'mi-nt a in a finite field P, which is such that 
= 1, io Galled an n-tli root of unity in P. If such an 
element a has an order n in P, it is called a primitive n-th 
root of unity In i*'. It will be scon in the next section i.e., 
section 7,3 that the n“th roots of unity in P play a central 
role in the development of the theory of P-I systems on P. 

In this connection, it io useful to recall (see remark 2.6.1) 
that while considorin/j the characterization of 2-1) P-I systems 
in terms of their eigenvectors and eigenvalues, we had moved 
over from tlu field of real numbers to its extension field, 
the complex number field, in view of the fact that the complex 
number field is algebraically closed while the real number 
field is not. In the complex number field, an n-th root of 
unity always exists for any given positive integer n, and 
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2 ' 1 £ 

it is given by i;xp(V“l * Similar situations necessitating 
the use of tin oxttuin J.on field arise, in the study of many 
types of systomo I 42,43 J* When we consider P-I systems of 
dimension n on a f ini to field P = GP(p), where p is a speci- 
fied prime number, wo may come across a similar situation. 

For a given n, n-th roots of unity may or may not exist in F. 

In order to derivt. ex pr cos ions for the eigenvectors and eigen- 
values of syotomn on finite fields, it may therefore 
become noecnanry to move over to an appropriate extension 
field, say tfF(p^”), whloh contains all the n-th roots of unity. 
In view of thi;!, wo shall first examine the question of exis- 
tence of n-th roots tof unity in P and the problem of identi- 
fying an appropriate t.'Xtonsion field in case F does not have 
n-th roots of unity i'ur a given n. 

Oonaider a ground field GP(p) where, p is a given prime, 
and its m-th order algubraio extension viz., 31' = GP(p^), where 
m is a positive; integer. F has p^-1 non-zero elements which 
are all distinct, anti by thoorera 7«2,3, are powers of a pri- 
mitive eleu'unt say a, whoso order is p^-1. If y n-th 

root of unity where n is some specified positive integer, then 
by theorem 7,2.5, yeP iff n divides p’^-l. Hence we have, 

lbe. or.em 7.2.6 i lot n bo a positive integer. Then an n-th ^ 
root of unity exists in P = GP(p“) iff n divides p“-l, i.e.,iff 
5 1 mod n. 
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If an n«th root of unity y is in P, then the 
elcmente y^, are all in P, and they are all distinct. 

IrM: Let a be a primitive elomont of P. Then, by theorem 
7.2.3, 

P = GFCp”) = {O.o^.o^ c«*’“-l = l) 

and, all these elenieriti arc distinct. 

Now, let. y be a primitive n-th root of unity in P and 
lot 

r - a" 

whore, k in a pun itive intoigor /?iven by (refer to theorem 

7.2.5) 

k = 

n 

Now, conaid(;r tiu; followln,^ set of n elements; vi-s. f-{ y-"} ■, 

{rb = { .... , j • (T.2.1) 

The n cltamjnta in the above sot thus correspond to distinct 
integer pov/orn of a, a primitive element of P, with the index 
always loss than (p”^-!), Honce, by theorem 7. 2. 3, they are 
all distinct elomonto -jf P. Now, 

: Lot n bo a given positive integer. If m is 
the least positive' integer such that n divides (p^^-l), then 


the sot { l,a^S .... , includes all the n-th roots 

of unity in F nF(p*^), where a is a primitive element of the 
finite iielfl F, tind k io a positive integer given by 
(p'‘^-l)/n. 

Proof: k = 

j> =1^-1 for every 

Therefore, (a ; * a - va / 

ieZ^I 


i.e., = 1 for ovory (7.2. 2) 

But Hlnou a io a prlmUlvo olotiK^nt of 1?, are all 

distinct olca ata of K = OHp”). 

(7.2.2), they arc all distinct n-th roots of unity in ®(p )• 
To Show that all the n-th roots of unity are Ineluded 
in tho abouo hot, lot p ho an n-th root of unity in SFCp ) 
hut not Inolmhid In tho above sot. Oiao PeSF(p )> from 

theorem 7.2.5 wo know that it must be some power of 

t 4. a ‘^ince P is an n-th root of 

mitivo element a, so let p = a. 


unity , 



Therefore, = 1 » 

Therefore, 1 must be a multiple of k 
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This implies that p is in the set { } , ieZ^. 

Thus, if n divides p“-l , GP(p“) contains n distinct n-th 
roots of unity and equation 7.2.1 enables us to locate them. 

Those results can be immediately applied to the pro- 
blem of identifying an appropriate extension field for a 
given P-I system of dimension n. Thus» as we shall see in 
detail in the subsequent sections, if we are given a cyclic 
P«I system of dimension n on a vector space defined ovftr the 
finite field G'P(p), we first check whether n divides (p-l). 

If it .does, all the elements of the eigenvectors of the 
system lie in the field GF(p). If a does not divide (p-l), 
we extend the given field GPCp) to GP(p^) such that n divides 
p^— 1 where m is the least positive integer' satisfying this 
condition. Then it fol'l.ows from the above results that 
G-P(p“^') has in it all the n distinct n-th roots of unity. 

Thus, GF(p^) is the extension field we seek. 

Remark 7.2.1 ; If the characteristic p (a prime number) equals 
2 and n is given to be even, or in general., if n is any 
multiple of the characteristic p, then there does not exist 
an m for which n divides p -!• 

Remark 7.2.2i In view of the foregoing discussion, in our 
subsequent study of the theory of cyclic P-I systems, we 
Shall assxime that the cyclic P-I system acts on a vector space 
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defined over G-P(p^) - an appropriately chosen extension 
field. 

will now consider a few examples that illustrate 
the ideas developed in this section. 

Example 7 » 2 , 1 1 Consider a cyclic P- 1 system of order 3 on 

GP(2), Assiime ttiat the system matrix is given by 
'"0 0 1 

T = ,10 0: . 

lo 1 0.! 

Since m = 2 is the smallest positive integer, such 
that 2® = 1 mod 5, we first extend the given ground field 
GE(2) to GE(2^). Now, GF(2^) = { 0,l,a,a^ }^Triaere a is a 
root of the iraii'eduoible polynomial (irreducible in 0’(2) but 
not in GP(2^))}f(x) given by 

2 

f (x) = X + X + 1 

Thus, GP(2^) has 5 distinct 5rd roots of unity, these being 
l,a and a^. Prom the system matrix we find that the chara- 
cteristic polynomial of the matrix is 

p(x) = + 1 = ( l)(x^ + X + 1} = 

2 

( X + l)(x + a){ X+ a ) 

(Note; Since the underlying field has a characteristic equal 
to 2, the arithmetic to be used is modulo 2 arithmetic). 
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Theroforot the eigenvalues are l,a and ^ and this correspon- 
din/r eigenvectors are respectively 




1 : : 1 
; 1 : a 


? 1 


2 . 


a 


i' 


a , 
a 


Thus, all the entries of the eigenvectors are con 

2 

tained in the extension field GF(2 ). 

lot n= 5, ana p= 2. Sinoe . = 4 is the 

smallest positive integer such that p“ = 1 mod n, the exten 

* lisls cc © S' 

sion field needed in this case is 

tive element of G5?(2 ), 

/ 2 14 1 

GF(2^) = {0,1, a, a", •••• » ® 

Tho 5 aistanot fifth roots of unit, in Gi’(2h are therefore 

ana 

§YS terns on.Xihtte,£i§l.S?- 

WttTthe requisite haoh^rouna ae.eiopea in the preoe- 

ain, sections, we are now in a position to proceea wi^ he 

■fio expressions for the eigenvalues and 
task of deriving specific exp 

„ roiic P-I systems on finite fields, itfte 

eigenvectors of cyclic . 

, -n pse these expressions for deriving the 

doing this, we shall u 

^ . >.tr these cyclic P-I systems, 

transform pair defined y 
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Lot T bo an n- dimensional vector space defined over 
a finite field F = Grl'(p^), where p is a prime and m is the 
least positive integer such that n divides (p^-l). Let yeF 
bo an n-th root of unity in F. Then 


= 1 


( 7 . 3 . 1 ) 


Let keZj^ybe a member of G-, a transitive abelian 
group of cyclic permutation matrices of order n. For a given 
keZ^, Pjj. is ab n X n matrix whose first column has a 1 in the 
k“th position and zeros else where, and whose other columns 
are all cyclic permutations of the first column. 

r ' - -»(n-k)-th position 
^ — j 

- 0 0 0 1 0 

0 0......0 0 L .... 

0 O...... 0 0 0».»» 


p _ * 

k ” 

* 0 

k-th position 1 

0 


0 


0 

0 

1 


0 

0 

0 


0 

0 

0 


0 0 

0 ...... 1 


0 

0 

0 

0 

0 


0 

0 ., 

0 .. 


0 .......0 : 


Ifote that a 1 appears in the (n— k)— th posicion in the first 
row. If we now define y^^ as 



then wo find that 



1 i 



Y ^ f or every heZ^ * 

(7.5.5) 


Hence y = = Y~^ is an eigenvalue of \ and the 

’ ^ r 2 

associated eigenvector is given by LI Y Y Y J • 

Prom ^aSc 7.2.6, we know that equation (7.5.1) has n 


distinct solutions in P given by 






(7.5.4) 


where is a primitive n-th root of unity in F. Hence, Y 

has n distinct values and therefore, P^. has n distinct eisen- 

values given by 

^ i. peZ^- (7.3.5) 

Thus, C 30 ,P. 187 ] P], has n independent elsonvectors and 
hence each is Individually dlagonallsahle . But then, we 
know that the being members of an abelian group, 

commute pairwise. 
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i*G., = \ . ^2. every 1, me Z^* (7.3.6) 


Therefore, Gr is a commuting family of diagonalizable linear 
operators on the finite dimensional vector space Prom 
standard results in linear algebra it then follows l3G ,p.207] 
that there exists an ordered basis for T such that every 
operator in G is represented in that basis by a diagonal 
matrix. This basis is provided by the ordered s et of n inde- 
pendent eigenvectors common to all Pjj.’s, viz., 



Yn ^ 



where 


I'n 


'n ‘ 


(7;3.7) 


and is the primitive n-th root of unity in P given by 

1 m T 

, k={V"’ 

and a is a primitive element of P. 

The class of P-I systems on V relative to G, are known 
[ij to form a vector space of dimension n, where n is the 
degree and order of G, the transitive abelian, group of cyclic 
permutation matrices. Members of tnis group, viz,, Pj^'s, 

keZ„, form a basis for this space. Since Pj^-'s have been 

^ ^ 0 
shown to have a common set^eigenvectors f peZ^ that span 

the vector space 7", it follows that the whole class of P— I 
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systems relative to 0, has a common set of linearly inde- 
pendent eiijonvectors^ given by equation (7.3.7), that span 
the vector space V. 

¥e now consider an example that illustrates the 
above ideas. 

Exampl o 7*?»l i Consider the class of cyclic P-I systems 
with 5-- tuples drawn from a vector space defined over SPCP) 
as input vectors. 

Thus, P = 2 and n = 5. 

Since m = 4 is the least positive integer satisfying 
the condition p^ — 1 mod n, the entries of tne eigenvectors 
of this class of systems will be in GP(2'). let the primi- 
tive 5“th root of unity in GP(2^) be y. Then y = a where 
a is a primitive element of Hence, the common set 

of eigenvectors of this class of P-I systems are 

(1111 1)^, (1 y y^ (1 Y^ Y^ Y Y^)^» 

(1 y^ y y^ Y^)% ^ 

The modal matrix u for this class of P-I systems is there- 
fore given by 
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If now P^'s, keZ^_ to mombors of a transitive abelian group 
of oyollo permutation matrices of degree and 
A, , tlien we have, 

* 1 0 0 0 0 1 


u-^ Pj, u = 


A 


1 0 0 0 0 ' 


OlOOO- 
0 0 1 0 0 ' 
0 0 0 1 0 * 
0 0 0 0 1 i 


0 Y^'O 0 0 ] 

A = ; 0 0 Y^O 0 i 

1 ^ 2 ' 

■ 0 0 0 Y 0 ^ 

0 0 0 0 Y i 


^ 1 0 0 0 0 

, 0 Y^O 0 ^ 

A ,2 = : 0 0 Y 0 0 

; 0 b 0 Y^ 

i 0 0 0 0 y' 


j 1 0 0 0 0 ; 

* ’* 

I 0 Y^O 00 
1 A 

_ ’ 0 0 Y^O 0 

I 

; 0 0 0 Y 0 ? 

I , I 

0 0 0 0 Y^ '■ 
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I 


and 


1 0 0 0 0 
0 Y 0 0 0 

0 0 0 ^ 
0 0 0 0 

0 0 0 0 y' 


T^o-firiPd bv Cyclic B:::d«SjrsteSS^^ 

*3.1 — 

llLnito Ji§.^ 

io P-I systems on an n- dimensional 

''nvi A gIslsb of cyclio i rv^ 

“ IS i; = SP(p®), has been shown 

rector space V over eigenvectors 

X ^-p n linearly indepeno.ent eig 
bo have a common sc ^.^sis for V, if x = 

S O- the-e n vectors form a oasis 

epP , peZ„. Since tiie>.e n , v then 

h any arbitrary veoror 

(xq X, .... ^n-1^ - . ^ 

^ n-l i 

n 1 + X T 9^” ~ ^ ^i * 

^=° (7.3.9) 

X isz are soalars belonging to P. 
where X^, _ . 

ivv -i th component of x, viz., j 
Therefore, the D- 

given by , , -,n^ 

n-l ii . iez , (7.3.10) 

n-l i,i y X. Yv.*^ * n f 

X. = I % i=0 

^ X=u 

(refer to equation 8.3.7) 


, y 'W — 

i.3 = yij la the i-th ==»P=-nt of the i-th eigen- 

i A is a primitive n-th root of unity m 

ector 9j^ and Yj^^ 
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Let the direct transform corresponding to equation 
7 . 3.10 be of the form 

""i = ^ J > (7.3.11) 

where EeP is a normalizing scalar yet to be determined. 

Substituting for from equation (7.3.11) in equa- 
tion ( 7 . 3 . 10 ), we have, 


X . 


rr 


n-l 


But we know that [15 ] 

n-l . n if q = 0 mod n 

I = -C 

1=0 ^ 0 otherwise 


Hence, 


n-l 

X = K I 
^ 1=0 


n-l 

X-, I Y 


i( j-l) 


i =0 


n 


= Xx.n 

ti 


(7.3.12) 


Therefore, the normalizing constant K must be such that 


Kn = 1 . 


(7.3.13) 


Since the field F is of characteristic p, all the summations 
used above are of mod p and hence, we may write equation 

( 7 . 3 . 13 ) as 

Eh = 1 mod p ^ • ( 7 . 3 . 14 ) 
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Since we know that 

. 1 = - 1 (mod p), 

it follows that K = -M where M is such that 
Mn = - 1 « 

Further, for convenience, we may transfer the normalizing 
scalar to the inverse transform. Hence, the direct trans 

form may he written 


X. 


(^y X. p » ^^^n , 

0=0 3 “ 


(7.3.15) 


and the inverse transform may ho written 


X 


= (-M X- yi^) ’^0'^ P f 

D * ■ rs 1 - 

1=0 


(7.3.16) 


is t.e primitive n-th root of unit, in . an. M ia 
an integer such that 

(7.3.17) 


Mn 


p"^ - 1 • 


/ ^ r 7 17) define a transform pair. It 

Equations (7.3*16) (7.3* . 

. these exactly correspond to the -Fourier 

may be observed that the s r. ^ 

fi-lds' proposed hy PoU-ard [15 ]. Since 
transform in finite fi^- >■ . _ 

.vPlic convolution and the fburier 

oyolio P-I systems perform oyolio oonvo 

transform has oySllo convolutional property, this is to ho 
expected. But the P-I system approach used hero has the 


185 


advantage that it leads in a natural way to a family of 
generalized transforms in finite fields. These transforms 
possess a generalized convolutional property so that the 
Fourier transform in finite fields derived in this section, 
becomes but a special case of this larger family of the 
generalized transforms. Utilizing the results of this sec- 
tion, we will be deriving these generalized transforms in 
the next section. 


4 generalized T rans for ms in Finite Fields 

) 

Let P.. , keZ be a member of a transitive abelian 
in. 


group G of permutation matrices of degree and order n. Let 

m , aeZ be the Invariants of group G so that 
cx 


n 


r-l 
n m 
a=0 


a 


( 7 . 4 . 1 ) 


Then, G can be expressed as the direct product of r cyclic 
groups of orders m^, cceZ^, Hence, be written as 

\ = Vl ® V2 ® ® \ ® '■ ’ 


( 7 . 4 . 2 ) 


where k , aeZ are the mixed— radix digics in the mixed— 
a’ r 

radix representation of with respect to the mixed- 

radices m , ae-2 and Q. is n cyclic permutation matrix of 
^ ^ a 

order m^, aeZ^. The s3niiboli(^i*epresents ironecker product 
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of matrices, the product matrix being written down using the 
familiar lexicographic ordering of indices. 

Since n divides p^~l and each one of the oceZ 

iZ 1 

divides n (refer to oquation( 7 . 4 . 1 ) ), the order of each one 

of the constitu^jnt . cyclic matrices Q-. , viz., m divides 

p°^-l. Thus, our earlier results pertaining to cyclic matrices 

Qjj. , aeZ^, keZ^. Hence, from equation (7.5.7), we may say 

oc 

that a cyclic permutation matrix such as has the following 

an 

set of linearly independent eigenvectors 9 ^ , 3^*^ 

Q V cc cc 

m^ distinct eigenvalues f ^a^^m ’ where 

a ^ 


9! 


^ n (1 yP 


m 


a 


m 'm 
a a 


Y 


k 13 
m 

a 


Y. 


(m^-l)P 


m 


) 


a 


f oceZ^ f (7.4.3) 


-Pk 


and a “ = v, 

yyi • 


a 


m 


a 


'm 


a 


» and asZ^ . (7.4.4) 


Yjjj in the above equations, is the primitive BiQ.-th root of 

unity in P. How, following the arguments of Siddiqi [l, also 

Appendix A. 7], in view of equation ( 7 . 4 . 2 .), the modal matrix 

H of P, , keZ is the direct product of the modal matrices 
33. ic jtl 

U of the constituent cyclic matrices 
™a a ■ _ 

Hence, the J-th eigenvector of viz., h^ is the 

direct product of the 32 ^- 2 “^^* •••• > 3 Qr*“th, 


3.-th olS.nveotors of . ^2 L 

° . „i7 are the mixed-radix digits in 

rospcctively » whore r .• m 

. . 4. 4-r. +hP! mixed-radices 


respectively, wnei^ Jqc’ ^ 

4 ^-1 with respect to the mixed- radices 

the expansion of j witn rc p 


aeZ . That is, 


h3 = •• 

*V 


.. © © 




j. ■ V, 7 A "5 ) we know that 
where from eciuation {!• 


Dec 

(1 v„“ V„ 

a ^ 


(m^-l)jcc T 




(7. 4.6) 


> hat the i-th component of h^ viz., hj^’^ xs 

Then it follows ^hat 


given hy 


hi' 3 

n 


1 T XY.„2^r— 2 
r-l'^r-l V • 


. . . Y 




r-1 


(7.4.?: 


n r 


41 m„ f 

a=0 ^ 


.w ^T/rits in the expansion 
, ■ „eZ are the mixed-radix digits 

Where 1^, cceZ^ m... cteZ^* 


where i„, ^ _ gg . 

“ , the Bixed-radioes m^, ots^j,' 

of i with respecx to th ^ 


. equation (7-4.2), o^ - ^ 

Again, in vie of the j^n-th. 


Againy in vie .j. p,f the 1 ,-th, . 

to the prodne 0 of ine j j,_i 

eigenvalue of Pj, is e<in ■ oonstituent oyclio 

3 „-th, ... and 3o-th eigenvalues o 
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matrices viz., , .... , 

r **1 r'~ 2 oc 


r-1 

respectively. Hence, 




A-l»^r-l 


n 


m 


1^1 


m 

a 


. 30’ '^0 


m, 


0 


Using Gluation (7.4.4), we may rewrite the above as 


n 


cfl’~ = Y, 


m, 


■J’r-l^r-l 

r-1 


Y 


-OqICo r-1 -j„k^ 


m^ 


= y *’“ « = 

’Tin 


A ^ 

a=0 a 


n ^ 
(7.4.8) 


where/ is multiplicative inverse of in P. 

Wc now observe that each one of the modal matrices 


U , aeZ pertaining to the constituent cyclic matrices , 

is a symmetric matrix similar in nature to the generalized 

Hadamard matrices of Bu.tson[55l order and that its 

entries are m^— th roots of unity in P. Srnce the modal 

matrix H of each P-,., keZ , is the -direct product of the 

modal matrices U ^aeZ , is also a generalized Hadamard 

r-1 

matrix of order n = II m and its entries are ij— th roots 
of unity in where t) is the least common multiple of 

m^, m 2 , , m^_ 3 _. The i, 3 -th element of is h^»3 

which is given by eq.uation (7.4*7) from which it is seen 
that 


.i»0 


n 


= h. 


0» J _ 


n 


= 1 




/ 


'n f 


(7.4.9) 
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and • (7.4,10) 


Therefore, the generalized Hadamard matrix is symmetric 
and is in standard form. It then follows from the proper- 
ties of generalized Hadamard matrices [ 35 ] that 


n-l 3 . 

H 0 

II 

hi. 3 

= ! 


(7.4.11) 

n-l . . 

y h^»^ 

i=0 ^ 

n-l 

= Jo 

hi.3 




n.— 1 “ ^ 
and y 

1=0 ^ 



f 

h, jeZ^ 

(7.4.12) 

T 

lc=0 ^ 

h3-‘^ = 


• 

• ^ 

i, 3eZn 


Further, from equation ' 

(7.4.7) 

it follows 

that 


hi. 3 h^>*" 

n n 

= >4' 




(7.4.13) 


where^ (+) denotes pointwise addition operatxon in the mixed- 
radix number system with mixed-radices ^2*-2**'* / ™ 0 ‘ 

R emark 7. 4.1°. The n x n matrix whose i,j-th element is h^» ^ 
the multiplicative inverse of hj»^ in R, will he denoted by 

H*. 

n 
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Then, 


H, 


n 




n I, 


'm 


where, is an identity matrix of order n. 


(7.4.14) 
Hence, it 


follows that 


h; 


n 


“ H* 
n n 


- M H* 
n j 


(7.4.15) 


where, the integer M is such that 


(7.4.16) 


In view of the fact that the class of P-I systems 
relative to G cons titut#' a vector space of dimension n for 
which the p.'s form a basis , the eigenwaotors h, . 
the P.'s keZ^, constitute the common set of eigenvectors 
for any P-I system defined relative to G. Purther, the ^ 
eigenvectors, being linearly independent, constitute a basxs 

for V, the signal space on which the class of P I sy ^ 

--p tfY is any arbitrary signal given 
operates. Therefore, if 

ty . 

,T_Tr (7,4.17) 




X = (xq x^ ^2 


X .) eV. 
^2 • • u— 1'^ ^ 


theny'we may write 


= (^^^ Xj h^) mod p ; 


(7.4.18) 
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where, is the j-th component of the vector 

tr4 4.'ln -fhn nnr] AT'^tandiUjS: t 


(Xq JCi .... 


metic involved is of mod p, we may w 
as 


yith the understanding that the arith- 

rite equation (7»4*1S) 


^ X . 


(7.4.19) 


From 


equations (7.4.15) and (7.4.19) « may wit e 

X = X = - M H* X . 


(7.4.20) 


After transferW the normalising constant -M from 
equation (7.4.20) to equation (7.4.19), ve may rewrite 
these equations alternatively as 


7 _ (“y^ h’^*^ T,) mod p 

3=0 




"k 


and X, 


= (-M^f n^’V ® ’ 

3 1d=0 

, r-1 Jet^a 

where^h^^^ = 


i 3» * 


(7.4.21) 

(7.4.22) 
(7.4.22) 


a=0 a 


of unity in F , 


Y is the primitive m^^-th root 

uez. are tUe invariants of the group 9 relative 
pertinent class of P-I systems 


to which the 


xs 


def ined, 
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ana 1C„ are tho mlred-radir digits in the expan- 
“aion of 3 and k respectively with respect to 


mixed- radices aeZ^» 

is the(k,3>-th element of H* and eqcnls the 
multiplicative inverse in r of and 

M Is an integer in S' such that 
Mn *= p“-l- 

r +• riQ f7 4 21) and (7.4.22) define a 

(.») -*■ “ " "V 

, ^ . ^hat for the particular case where^ 

It may he ohserved that to ^ 

n V. the invariant iS n so tha 
G is a cyclic group of or er , . - (7 4 2l) and 

Thus, in this case, ,*he e.uatrons (T.4. 

^ ^ . the Fourier transform xn fxnxte 

( 7 . 4 . 22 ) reduce to those 0 

Cv 15 ) nnd (7.3 

fields given hy equatxons 

. 4--nr, Theorem for P-_I JZ^§SS 

9enerali.ged„0onvolution Th. 

on Finit,e,_FielJnS, 

lutional relationship between the 
The generalised convo ^ ^ 

nput and outPut vectors of 

n section 1. Ihxs, to. ^ ^ generalised 

.erived in the previous section. 


'.5 
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convolutional theorem, according to which, the generalized 
I'M of the convolution of two signals is equal to the point- 
wise product mod p, of the corresponding eleraents of the 
generalized PM's of the individual signals. Pormally, let 
the vectors x,s and y be respectively the input, unit sample 
response and the output pertaining to a P-I system on ®'(p ), 
Also, let X, S^and Y be the generalized FM‘s of x, s^and y 
rosp^ctiyely. Then 

= Cl Yi) “lod p ,• (7.5.1) 

i=0 

But, from equation 7.1.2, we have. 






where denotes pointwise subtraction in the mixed— radix 

number system with mixed— radices that are invariants of the 
pertinent transitive abelian group G relative to lAiich the 
F— I system is defined. Therefore, substituting equation 
(7.5.2) in (7.5.1) we have. 


= 'io ‘S ® 
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jaO i=0 ^ 


Now, substituting 1 - i 


3 in tbe above, we have 


k j" 0 ^ 1^0 


mod 1 


But (refer to 


equation (7.4.13)) we Imov that 




k, j 


Therefore, 


’k 


(((I ^ 

0=0 


1 :rk,l g ) mod p)) mod p 

(C L V 1 

1=0 

(X^ . Si,) -nod p . 


Therefore , 


= (J.^ . Sj^) mod P ^ 

rtaWished the generalised 


• “k 


Thus we have e 
theorem for P-I syate.e an finite fieWa. 






(7.5.3) 

convolution 
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7.6 

In this section, we study the theory of P-I systems 
on modules defined over a ring Zp of residue class integers 
modulo P, where P is a positive integer. These P-I systems 
have as their input and output signals, sequences of some 
arbitrary length n, whose entries are drawn from the elements 
of Zp* The sample domain description of these systems ' 
structurally the same as that of P~I systems over vector 
spaces! the minor modifications that are needed in 
ss ions for convolutions, necessitated by the nature of 
underlying ring, have already been indicated in section 7.1. 

u -io +n develop the transform domain 
The main concern here is to deve p 

4 ? D T ave+ems. As a first step in 
theory of this category of P-I sy 

the development of this theory, « oonsider the oyolic class 
P-I systems, and later « extend the results ohtamed for 
this class to general classes of P-I systems. 

Consider a cyolio permutation matrix belonging to 
S, a group of cyolio permutation matrices of degree and or or 
n. That suoh a oyollo per^tation matrix has povers o 

shown in section 7.3 in the process of derrvxng expressions 
for the eigenvalues and eigenvectors of cyclic P-I sys ems 
+ Id P For obtaining that result concerning 

on a finite field, P. 

4 - 0 n-f cvclio permutation matrices, 

the entries of eigenvectors of cyclic p 
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we made use of the property of a field not shared by a ring/ 
only when the multiplicative inverse of an n-th root of unity 
in F was utilized. In this context it is to be noted that 
even though, every element of a ring need not have an inverse, 
an n-th root of unity, say y, if it exists, then it does have 
an inverse, the inverse being Hence we conclude the 

following; 

t 

Remark Y.t 6^.1; The result of section 7,3 concerning the 
entries of the eigenvectors of cyclic permutation matrices 
can be applied to the ring Zp also, provided an n-th root of 
•unity exists in this ring. 

Hence, to begin with, ■we shall first examine this 
question of the existence of n-th roots of unity in Zp, and 
the methods to determine them* later, using these n-th roots 
of imity, we will proceed with the task of deriving expre- 
ssions for the eigenvalues and eigenvectors of cyclic P-I 
systems on a ring Zp, 

The use of the term 'eigenvector* in the context of 
modules perhaps requires clarification. Just as we talk of 
an eigenvector of a transformation on a vector space, by an 
eigenvector of a transformation t on a module M, we mean here 
a member xeM such that 


tx = XX, 
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where x is in the ring underlying M. The existence of 
either the eigenvalues or the eigenvectors is not in general 
guaranteed in this case. However, as. we shall presently see, 
with a suitable choice of the dimensions of the modules and 
the P-I systems on them, we are assured of the existence of 
these eigenvalues and eigenvectors. 

7.6.1 n-th R oots of Unity in Zp 

As mentioned earlier, we now examine the question of 
finding the n-th roots of unity in Zp. ¥e do this in three- 
stages. First we consider the simple case when P is a prime 
number. Hext we assume that P is some power of a prime 
number. Then, finally we consider the most general case when 
P is any arbitrary positive integer, 

a. P is a prime number: li'ftion the mod^ilus P of the ring 

Zp is a prime number, say p, the residue class integers 
modulo P viz., 0,1,2,.'. (p-l), form a finite field F 
of order p. The method for determining the n-th roots 
of unity in this case, has already been discussed in 
detail in section 7.2, However, for the sake of 
completeness, we briefly summarize those results. 

The order of any element in F must divide (p-l) since 
p is the order of the finite field F. An element ysF 
with an order of (p-l) is called a primitive element 
of F and we know that every finite field will have a 
primitive element. Then the various powers of y 
generate all the non— zero elements of F so that 
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F = { 0, y^, y^, , y^^ = 1} . If xeF has an 

order np then n divides (p-l). Since xeF, let 
x = Then X, x^, x^, .... , x“ will all be 

distinct elements of P and all these n elements are 
n-th roots of unity in F. The element x, which 
has an order n is known as the primitive n-th root 
of unity in F and successive powers of it generate 
all the n possible n-th roots of unity in F, Thus, 
if (p-l) ic di'^/isible by n, then there are n number 
of n-th roots of unity in the field P of residue 
class integers modulo p where p is a prime. If (p-l) 
is not divisible by n there will be no n-th roots 
of unity in F. Further, once we identify a primitive 
element of F, the method outlined herein can be used 
to determine all the n-th roots of unity in F, 

Exa mple 7. 6.1 ; Consider the residue class integers 
modulo 7. These form a finite field F of order 7 
given by F = {0,1,2,3»4,5,6 j , The elements 3 and 

5 belonging to F have an order of 6, i*e. , 6 is the 
smallest positive integer such that 

# 

3^ = 1 mod 7, 

and 5 - 1 mod 7 * 

Hence 3 and 5 are primitive elements of F. Considering 
3 as the primitive element, 

F - { 0,3^, 3^ = 2, 3^ = 6, s'* = 4, 3= = 5, 3® = H - 

Therefore, if n = 3, a primitive 3rd root of unity 
in F is = 9=2 mod 7. Therefore, 2 is a primi- 

tive 3rd root of unity in F. Hence, the three 3rd 
roots of unity in F are 2 , 2 and 2 ^ i, e., 2,4^and 1. 



Note that even if we express all the non-zero 
elements of F as powers of the other primitive 
element, viz,, 5, we will obtain the same set of 
3rd roots of unity in F, 

b, P Equals the power of a prime : How, let us consider 
the ring Zp, P = p®, where p is a prime number and e 
is some positive integer. In Zp the multiplicative 
order of , any element is defined if and only if the 
element is relatively prime to p®. The number of 
such elements in Zp is given by. Euler ^s phi/function 
9(p®) = p®~^(p-l). The set of non-zero elements of 
Zp that are relatively prime to p^ will henceforth 
be denoted by P(p®). Then it is known [45 ,p,32] 

that P(p®) forms a multiplicative C 3 rclic group of 
order 9 (p®), For p greater than 2, (it will be clear 
from the sequel that this is but a trivial restriction) 
any element of P(p), i, e, , the field of integers 
modulo p, which is greater than 1 can be a generator 
of this cyclic group. let y be an element of this 
cyclic group P(p®) and let its order be n. Then n 
must divide the order of the cyclic group i.e, must 
divide ^(p®). Since 9(p®) = p^®“^^(p-l) and p is a 
prime, it follows that n must either be equal to p^ 
where q is an integer such that 0 <q< (e-l), or else 
it must divide (p-l). How, if x be the generator of 
this cyclic group P(p®), = 1 mod P. ^ Since 

yeP(p®) is an n-th root of unity, y Then 

the elements of the set {y^» } ^.re 

distinct elements of P(p®) and form the set of n n-th 
roots of unity in Zp, Thus, there are n possible n-th 
roots of unity in Zp if n divides ©(p®),* otherwise, 
there will not be any n-th root of unity in Zp. 
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I’uirther, tlie element y defined as above, is a 
primitive n-th root of unity in Zp. 

Remark 7» 6«2 i An element ysPCp®) ■wiiicii has an order 
n is called primitive n-th root of imity in Z 

Example 7.* Consider R, the ring of residue class 

2 

integers modulo 9=3. 

E= {0,1, 2,3, 4, 5, 6, 7,8} 

2 1 " 

9(3 ) = 3 ( 3 -I) = 6. Thus, there are 6 integers in 
R that are relatively prime to 9. These are 1,2,4, 5, 7 
and 8. These constitute a multiplicative cyclic 
group of order 6, As mentioned earlier, any integer 
greater than 1 which is an element of the field P of 
integers modulo 3, can be a generator of this group. 

In this case, 

E = {0,1,2 }. 

Hence, the generator of the cyclic group is 2 in this 
case. Thus, we have, 

2=2 mod 9 
2^= 4 mod 9 
2^= 8 mod 9 
2"^= 7 mod 9 
2^= 5 mod 9 
2^= 1 mod 9 ' 

If we now have n = 2, a primitive 2nd root of imity 
in R is given by 2^^^ = 8. Then, 8^ = 8 mod 9 and 
8^ = 1 mod 9, so that 1 and 8 are the two second 
roots of unity in R. If n =3, a primitive third 
root of unity is given by 2 = 4 mod 9. Then, 
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4^ a 4 mod 9, 4^ s 7^ and 4^ s i mod 9 so that 1,4^ 
and 7 constitute the three 3rd roots of unity in fi, 

c, P, the modulus is an arhitrary positive integer. 

let the unique prime power factorization of P yield, 

r-1 e. e^s e, e , 

P — . ^i ~ ^0 * ^1 ••••• Pp_q j( (7.6.1} 

where p^^, ieZ^ are distinct primes and e^, are 

positive integers. 

¥e now define a ring E* as the direct sum of the 
rings ieZ^ as follows; 

R — ^^0 ^ ^1^ ^2 * • • • • t » . » . f f (7. 6.2) 

where each R. , igZ , is the ring of residue class 
integers modulo p^ . Thus, in this ring R* , an 
arbitrary element a will have a representation! 

a — ( aQ f a^^ > a2 » .... , a^^ , .... , ^ * 

asR*, a^eRj_, ieZ^ , (7.6.3) 

If a and b be any two arbitrary elements in R , 
addition and multiplication 0 operations in 

the ring R* are defined by 

a0b J (xq,x^, .... , x^, .... » , 

e. 

where x^:i (aj_ + b^) mod p^^ , 


(7.6.4) 
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and, a0l>^ ..... y^_j^ ^ 

e. ( 7 , 6 , 5 ) 

where (a^ • Pi * 

Since the number of elements in a constituent ring 
6 * 

= Pj_^» the total number of elements in the ring fi* 
is given by , 

3>-l e. 

n Pi = P * 
i =0 ^ 

There is an isomorphism between the ring R* and the 
ring Zp of residue class integers modulo P and the 
mapping between them is provided by the Chinese 

-i. 

remainder theorem (CRT) [ 44 ] . If we let = P^ * 
ieZ^ and consider an element aeR* having a represen- 
tation given by equation ( 7 . 6 . 3 ), then the element 


beZp that corresponds 

to asR* 

, is given by 

the CRT 

as 




■ r-1 

1 



PI P =. 

m.e 

X' 

mijp 


= m. a. 

U=o ^ ^ 

• 1 L 

■ m* ^ 

1 

% 

t 

(7.6.6) 

: P ^ 



where 



r-1 3>-l e. 

P = n m . = n p - ^ , 

i =0 ^ i =0 ^ 



(multiplicative inverse cxf mp)mod ^ 


and I q I stands for q mod k. 
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Rema,rk 7. 6. 5 ; According to this direct sum representation 
of Zp, the unity element of Zp has a representation 

1 ^ ^ 1 J 1 • • ■ • 3^ 1 y y 1 ^ • 

¥ith this background we are now in a position to show 
that there eicist n distinct n-th roots of unity in Zp and 
also identify them. 

Let ieZ^, be a primitive n-th root of unity in 

R^. This means that n is the smallest positive integer such 
n ®i 

that = 1 mod p^ . In section 7.6.1 it has already b een 
shown that such an element exists in R^ if and only if n 
divides (p^ - l) or Since Pj_’s are distinct primes, 

it follows that a primitive n-th root of unity exists in each 
one of the R^'s if and only if n divides each (p^-1), i = 0,1, 
... , (r-l). In other words, n must divide ((Pq-I), (p^-l), 
(p 2 -l), .... , (Pj_~l)j .... » (p^_p-l) where (a,b) denotes £he 
g. c.d.of a and b. This g. c.d then represents the largest 
value that n can possibly have, for a given modulus P. It 
may be mentioned here that Agarwal find Burr us [20 ] have 
given this condition, namely, that n must divide the g, c. d 

((Pq- 1), (Pp~l)> * .*• > •••. » ( ^ ^ ^ 

single necessary and sufficient condition for n to be Q- 
possible number theoretic transform J.ength in Zp. Assuming 
tb(it the given n divides the g»c.d. stated above, a primitive 
n-th root of unity inZpmay then be represented by 
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** ^ ^ 2 * • • • • » » • * 0 • / 1 ^ f (7* S»7 } 


■wheret eacli a^eR^^, ieZ^# is a primitive n~t]i root of unity- 
in R^* Then, since a^, q = 0,i, .... , (n-l), form distinct 
n-th roots of unity in R^, isZ^, and since the representation 
in eqiiation (7.6.7) is -unique, it follows that Q. = 0,1,,. 

. , , (n-l)^ form a set of n distinct n-th roots of unity in 


7.6.2 Eige nvalu es and Ei g env ec tors 

If G he a 'cransitive abelian group of cyclic permuta- 
tion matrices, referring to remark 7.6.1 it now follows that 
a cyclic permutation matrix ^^^n^ has n distinct eigen- 

values given by 



where, Pi'iniiiive n-th root of unity in and is 

given by equation (7.6.7). 
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ITliua, the cyclic permutation matrices, belonging 

to the transitive abelian group G of cyclic permutation matri- 
ces, have a common set of n eigenvectors given by equation 
(7.6.9). 

¥e shall now show that these n eigenvectors provide a 
basis for the module M over Z , For this purpose, we first 

Jb' ' ■ 

note that the set of elements { }» where each e^ is 

an element of M with a 1 in the i-th position and zeros else- 
where, forms a basis for M, and that the eigenvectors of 
cyclic permutation matrices I’jj.’s belonging to G given by 
equation (7.6,9) are written with respect to this basis. The 
n eigenvectors provide a basis for M if and only if the modal 
matrix formed by these eigenvectors is invertible [46 ,p,104]. 
The invertibility of the modal matrix has been shown in [47] 
in connection with the invertibility of iTT'f’s. The eigen- 
vectors (given by equation (7.6.9)) of the cyclic permutation 
matrices belonging to G-, therefore provide a basis for 

M. In other words, have a common set of linearly inde- 

pendent eigenvectors that generate M. 

Remark 7 . 6 . 4 : The invertibility of the modal matrix guaran- 
tees that its determinant has an inverse in the ring 
[ 46 ,p. 106]. 

Since any member of a class S of P-I systems is a 

[PR5 of A. 6, Appendix A] it 


linear combination of the Pjj-’s 



follows that a class S of P-I systems has a common set of 
linearly independent eigenvectors that generate M. So, with 
these eigenvectors as a basis for H, the system matrix of 
every member of this class S takes a diagonal form^ 

We now give the following example to illustrate these 

ideas? 

Ex am pl e 7»6.3 s Consider a cyclic P-I system with n = 2 over 
a module defined over the ring of residue class integers 
The system matrix is T = [ 53 ], P = 15 = 3 Therefore Pq=3 

Pl=5,*Zi^ = {0,1,2,3,4,5,6,7,8,9,10,11,12,15,14}, If 
(x,y) be the residue representation of any integer wsZ^^, i,e. 
if w = X mod 3 and w = y mod 5, then by the CRT 

w = jlO.x + 6 .y|^^ . 

Therefore, integers 0 to 14 belonging to Z^^ have residue 
representations given in the following table; 

Table 7, 2 : Re sidue Re presentation of Mumbors 0 to 14 
in Exa mp le 7.6 .3 
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Table 7* 2 s ( continued ) 


w 

C3c,y) 

w 

(x,y) 

2 

"“’'’”(2,2)'“''’ 

11 

(2,1) 

3 

(0,3) 

12 

(0,2) 

' -.r: ^ 

(1,4) 

13 

(1,3) 

5 

(2,0) 

14 

(2,4) 

6 

(0,1) 



7 

(1,2) 



8 

(2,3) 



✓ 

Z^ = { 0,1, 

2 } ^ and — {0^1, 2 , 3 f 4 } , 


The primitive 2nd 

root of unity 

in Z_ is 2 

and that 


is 4. 

Hence, the primitive 2nd root of unity in is the 
one with (2,4) as its residue representation. Referring to 
Table 7*2, the primitive 2nd root of unity in Z^^ is 14* 
i.e., Y 2 - 

Using eq.uation(7* 6.8) , we may now write down the 
eigenvectors of the given class of cyclic B-I systems as 

(iP = X X 1 

and 9 ^ = (1 14 
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Tho modal matrUc la thorelore 


1 1 


TT — ■ and U*” 

= ; 1 14 I 

5 -*# ■ ■ - ^ 


, I 8 8 -.8 5 

ir-^TU = I 8 7 j IJ 8 


a 
1 = 


1 ”14 -1" 7 14 ; = ;e 8 

-1 .X 4 = 7 14 1 ; j 8 7 

. r 1^, ,. 


I’ll!- = i 1 14 i !^o 3 I . 
J J_1 14j| I 9 ®ji_^ L - 

t.o modal matrix g i,] dlagonalloea t.o 

matrix iff! .ieldlns 15 and 3 as t.e el.envaluos ol 

i_r - 

system matrix. 

7.6.5 

Rooalllng that the eigenveotors cpj. 3 =^^ span tto n 
almenslonal modnle . dellned o 7 er Z,. an arbitrary srgnal 

X )^£li may "be "written <x# 

X = (2^0 • * • * n.-l 

X = Xq 9° + + •••• 1^0 ' 

/ 

X ieZ are scalars belonging to Z^. 
where l-j_ 

.^refore, the 37^^ component of x vi.. , ic 


t>y 


4 / n -o- .A3 . jeZ, 


^ .^3 = I X, Y 

^i ^h i 4 o 


^ ^ X, 9 i,'“ = . 1 ^ 


n f 


(7.6.10) 


L^O 


■u.^-,^0 is the 

where 9 ^^ 


component of the i-th eigenvector 


9: 


a la a primitive n-th 


root of unity in Z^. 


n 
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Let the direct transform corresponding to 7.6.10 be 
of the form, 


X 


n-1 

i = ^ I y: 
^ 1=0 


-la 

n 




(7.6.11) 


where . KeZ is a normalizing scalar the value of which as 
yet to be determined: Substituting (7.6,11) in (7.6.10) we 
get. 


n-1 - . n-1 


K X J „ V 


-il 


i=0 


i=0 


n-1 _ 

K I x, I Y 

1=0 ^ i=0 


n-1 


lU- 

n 


let (j-l) = 1 then, we know that[47]> 
n-1 . ^ n , if q. = 0 mod n 

y Y ^ t 

j_^0 0 otherwise * 


Therefore, 


K X = E X. n . 

^3 = l!o ^ i=0 ' 


This means that the 


Eh = 1 mod P, i.e. , K = | ^| 


3 normalizing constant E must be such that 


Thus . 


if n has a multiplicative inverse, say E, in Z^, 


then 
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n~l 

( \ X. r / - - n ^ 


y“^^) mod P I 


( 7 . 6 . 12 ) 


n-1 


and 


(E J S- Yn ^ ^ 

iio ^ ^ 


(7.6.13) 


Equations (7.6.12) and (7.6.13) give the finite 
discrete transform (PDT) pair defined hy cyclic P- I systems 

on a ring Zp. 

7.6.4 Numb e r ~Theor e.lic__Transf,o Sag. 

It may te observed that the PBI defined by oyelio 
P-I systems on Zp has essentially the same struot’jre as the 
familiar II?T pair. Further, just liho the FUT defined by 
oyollo P-I systems on finite fields, end the PFT, the PM pair 
of equations (7.6.12) and (7.6.13) also pdssessos oyollo 
oonvolutional property In that the pointvise product of the 
PM of two finite sequences ef equal length with entries from 
Zp, is oongruont to the PM of the oyollo oonvolutlon of the 
two sequences. Thus, these transforms may he used for com- 
puting oyollo convolutions. When used for this purpose, they 
have an advantage over the DPT because in the computation of 
this transform, imiltiplioatlcn and addition of only integers 
is required and the arithmetic In the computation is carried 
out modulo P, where P is the modulus of the underlying ring 


Zp« 


If this modulus P of the riri^j Zp is chosen to be a 
Mersenne number given by 

\ = 2 “ - 

whersf'n is a prime, then 2 is the primitive n-th root of 
unity in Zp. The PDT given by equations (7.6,12) and ( 7 . 6 . 13 ) 
and defined by cyclic P-I systems of dimension n on Zp then 
gives the Mersenne number transform (METT) proposed by Rader 

Cl6 ]. 

If, on the other hand, P, the modulus of the Zp is a 
Permat munber given by 



where t is any positive integer, then the FPT given by equa- 
tions (7.6,12) and (7.6,13) and defined by cyclic P-I systems 
on Zp, leads to the Permat number transforms (i'^RT’s) discu- 
ssed in [19,20], Thus , 

Rem ark 7. 6, 5 » For appropriate choice of P, tho modulus of 
the ring of residue class integers Zp, the PDT defined by 
cyclic class of P-I systems on Zp gives rise to number theo- 
retic transforms like the Mersenne number transforms and the 


Fermat number transforms 


212 


7,6.5 

The study of P-I systems on rings has so far been 
concerned only with systems belonging to the cyclic class. 

The results obtained for this class may be extended to 
general classes of systems belonging to this category by 
following essentially the same arguments and procedures as 
were used in section 7. 4. for obtaining the results pertai- 
ning to general classes of P-I systems on finite fields. The 
fDT pair defined by general classes of P-I systems on iS 

then 




( y h^*^ X.) mod P f ^ (7.6.14) 

3=0 “ ’ 


and 


where 


X. 


h' 


h, j _ 


n 


n-1 
(K 1 


1^0 

r-1 


= 51 

a-=0 

a 


3 f heZ^ ^ 


(7.6.15) 


is the primitive m^-th root of unity in Zp, 

m , aeZ^ are the invariants of the group & relative 
to which the pertinent class of P-I systems is 

defined, 

3 „ and are the mixed-radix digits In the expansion 
"of 3 eld k respeotnrely with respect to the mixed- 

radices m^, aeZ^, 
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is the multiplicative inverse in Zp of and 

K is the multiplicative inverse in Zp of n, 

Eema rk 7» 6.6: The generalized EDT pair given by equations 
(7«6,14) and (7.6.15) and defined by general classes of P-I 
systems on Zp are expected to be helpful in developing newer 
verities of ETT’s which will have dyadic and such other n on- 
cyclic convolutional properties. 


CHAPTER 8 

C 0 N C I, U S I 0 HS 

¥e have studied three new categories of permutation- 
invariant (P-I) systems as generalizations of the one-dimen- 
sional (1-D) P-I systems over real fields. These three new 
categories are 

i. 2-D P-I systems whose input signals are 2-B arrays 
of reals of finite size, 

ii, P-I systems on finite fields, whose input signals 
are finite-length sequences of elements drawn from 
finite fieldsman! 

_iii, P-I systems on rings, whose input signals are finite- 
length sequences of elements drawn from rings of 
residue class integers. 

Systems "belonging to the first cat€gory,i.e^ 2-D P-I 
systems, have been studied in detail with regard to their 
sample domain as well as transform domain behaviour. In the 
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case of the next two categories, the main concern has been 
the transform domain behaviour, their sample domain behavi- 
our being essentially the same as that of 1-D P-I systems 
with real-field inputs- 


8.1 Summary o f Result s 

Of the various results obtained in the study of these 
three new categories of systems, the main ones are the 


f ollowingl 


i, 2-D P-I systems have been formally defined making 
use of two transitive abelian permutation groups, 
one for the rows and the other for the columns of 
the input signal array. Following the general 
practice in the study of systems, several chara- 
cterizations of these 2-D P-I systems have been 
obtained. These include their characterizations 
in terms of the unit response matrices, generali- 
zed convolutional input-output relationships, 
eigen signals and generalized 2-D finite discrete 
transforms. The results on these characterizations 
depend centrally upon the fact that a class of 2-D 
P-I systems forms a vector space whose dimension 
is equal to that of the pertinent signal space on 
which that class operates. 

ii. It is shorn that Just as the 1-D P-I systems are 
capable of spectrum shaping or filtering of 1-D 
finite discrete data, the 2-D P-I systems are 
likewise capable of filtering 2— D finite discrete 
, data. 
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, „ 1 + r,f the thesis is that for every class 

iii. A key res^t of the thes ,lass 

of 2-D p-l systems, there p.t 

of equivalent 1-D P-I syatems. ^ 

aystems belonging only to the 

classes aere known to have sig^fr 

processing of finite discrete 

concerning the equivalence between 2-D a ^ 
syatems brings out the fact that mos c of the ot 
classes of 1-D P-I systems too have a 
role in the processing of finite discrete data 
since they are the 1-D equivalents of some two- 
ILensional or multidimensional P-I systems belon- 
ging either to the oyclio or dyadic olasso* 
usefulness of this equivalence between 2-P “ ' 

P-I systems in the 1-B implementation of 2-D f 
has been demonstrated through several examples o 
p-p pourier domain and Walsh domain 

establishing the sr^tLa 

S writing down the Kroneoker ^ 

■U4- --w, o n-n-ified treatmenc so tnax txiw 
order to obtain a uniixea ox , . ^ich 

o Titr valid irrespective of whicn 
presented are equally uqed for obtaining 

particular linear transformation is used 

the equivalent 1-B B-1 system. 

Theories of P-I systems on 

have been developed. In prcoe- 

theory of P-I systemson 

dure for determining ^ed."^ Characte- 

of residue class these two new categories of 

rizations of classes of these xwo 


iv. 


t ^ application of the same ^ JJ^hy 

tibility of NTT's has recently been repo 

[47]. 
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systems in terms of the pertinent eigen signals and 
finite discrete transforms have been given. It has 
been shown that with an appropriate choice of the 
modulus of the ring of residue class integers, the 
transforms defined by the cyclic class of P-I systems 
on rings lead to the so-called number-theoretic 
% transforms (UTT.'s) like the Mersenne nximber trans- 
form and the Permat n^lmber transform, which have also 
been proposed during the last few years for efficient 
and error-free computation of convolutions. Trans- 
forms defined by other classes of P-I systems have 
been derived here and it is hoped that they .irould be 
helpful in evolving newer varieties of NTT's with 
dyadic and such other non-cyclic convolutional pro- 
perties. 


8«2 Sco pe for Furth er Research 

Three distinct possibilities for further research are 
suggested by the results presented in this work. 

i. Results on the equivalence between 2-D and 1-D P-I 
systems provide a new alternative to the problem of 
2-D filtering using 1-D techniques. However, for a 
full and proper exploitation of these results, there 
is need for further investigation on two basic problems, 
namely, (a) the problem of approximation, particularly 
of the minimax kind, on discrete point sets, and (b) 
the problem of recursive realization of the 2-D trans- 
fer functions obtained by approximating the ideal. 



ii. Linear se<lUGntial circuits (LSD's) are discrete- 
time LSI systems whose infinite length input and 
output sequences have their entries drawn from 
finite fields such asO'(2). for these LSD's a 
fault analysis procedure has in recent years been 
suggested [ 42 J which is analogous to the well- 
known multifrequency techniques employed in the 
case of analog)^ circuits. It is based on a 
spectral- theoretic approach to the problem of 
fault analysis. Since P-I systems on finite 
fields are finite discrete counterparts of these 
LSD's, it is reasonable to expect that they will 
have analogous applications in the realization of 
digital systems. In that context, spectral— theoretic 
fault anal 37 ’s is techniques for P-I systems should be 
useful, 

iii. Linear sequential circuits in the autonomous mode 

(ALSC's) generate output sequences that are inheren- 
tly periodic j this periodic output for any given 
feedback structure of the ALSO, is dependent only on 
the initial conditions, or the initial state of the 
ALSO [ 48 ]. ALSO’s are widely used for the genera- 
tion of pseudo-random sequences. It appears that a 
p_I system formulation can be given to these ALSO's 
so that the same output sequence may be generated 
for the same initial conditions. If the usual con- 
cept of linear shift associated with the shift regi- 
sters is replaced by permutations, then a generalized 
concept of LSD's based on the theory of P— I systems, 
is likely to emerge. Such a generalized concept may 
have useful applications in the generation of pseudo- 
random sequences, In this context, the results on 
the equivalence of 2-D and 1-D P-I systems, Tdien 
extended to finite fields and rings, are likely to 
play an important role. 


MmMMI A 


In thiB _4pp®iidix> St &vum&ry of th@ ttoLOOry of 1-D P-I 
systems with real field injwts [l] is ^iven. It contains in 
some detail, all thowe results to which reference has been 


made irt this 



the mixed-radix number system is 
>this ,thesis in the general setting 


ry of rings, in order to obtain in a more compact 
manner several results derivable in terms of 
this number system,, ' 


A. 1 Intr oduction t o P~I Sys t ems 

The familiar cyclic and dyadic convolution systems, 
also called the cyclic and dyadic invariant systems, repre- 
sent twr Torj ..pocial cases of a more general family of 
classes of finite discrete linear systems in which members 
of each class of systems exhibit invariance in their injmt— 
output relationship to a particular chosen set of shifts or 
permutations of their input signals, Men the pertinent in- 
put signals are of length n, these various sets of permu- 
tations are identified as transitive abelian groups of permu- 
tations of de^sree n, by imposing on them requirements similar 
to those possessed by the sets of time shifts in the case of 
ITI systems. Each transitive abelian permutation group of 
degree n is then used to define a class of permutation- 
invariant (P— I'^systems of dimension nowhere n denotes the 
length of the input signal. 


Definition jljli Lot a LO . tran.ltlve aOalien permtetion 
group of degree n end let p denote en element in a. Ihen a 
finite dieorete linear system S is said to be^permutation- 
inyarient relatire to » if for any signal xsH“, 

'■ ' ;■ ' ■ (A.l) 




^eG- Is treated as an operator on R # 

The set of all such systems relative to a given ff is 
said to form a class of P-I systems of dimension n. 

In the above definition, if G is a cyclic (dyadic) 
group, then the resulting class of P-I systems relative to ® 
is known as the oyolio (dyadic) class of P-I systems. With 
classes of P-I systems defined as above, the number of classes 
of P-I systems of a given dimension n is simply equal to the 
number of distinct abstract abelian groups of order n. Alcb 
ray be enumerated using standard results in group theory. 

In the study of P-I systems, oyolio groups have an 
important position. This is owing to the fact that any 
finite abelian group is the direct product of oyolio groups. 

p. + pnn'^ider some of the salient features of 
We, therefore first consider some 

cyclic permutation groups in a brief manner. 
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A, 2 



L«t 0 l>« » oyoU® of psrmutatioii matrlooa of 

aesree ». • *%» !**’■. oraw? tarS elements In tte foUowln* 

.aannen. openatins on 

■'*' ■''' ■' '' ■ ' 2nt to the k-th position, 

i>J;t'ilie'’''s5eroth column of Pjj. hao a 1 ia 
and zeros elsewhere, and all other columns of 
P are cyclic permutations of the zeroth column. It can then- 
he seen that the (i,j)-th element of the cyclic permu- 

tation matrix P^^eG is given hy/ 


,e3 

’^‘rf * , 

V/ ^ : ,? ' V ’ /I ' ^ 

. n “I 




^^k^i,d “ '^k,(i-j) 


i,3»keZ 


m 


m 5 


(A. 2) 




where (l-j)„ denotes modulo m subtraction of j from i. 


. .-jB 

Equation (A. 2) equivalently means that the i-th row of ^ 
has a 1 in the l-th position where -1 is given by 


I 


z = (i-k) 


(A. 5) 


m 


Further, 


^k* ?1 


^(k + 1) 


(A. 4) 


m 


We shall now use these properties of oyolio permuta- 
tion groups in the Indexing of finite abelian groups, with 
the help of what is called the mixed-radix number system. 


i .3 




•A-. c 


£«* 5 -ft. •■■beum ero^V of “* 

j.. Jt'Wi «ti'»yis£' o«* expressed as the direct pro- 

cyclic components, let 

X ^r«-2 ^ 0/ 


(A. 5) 


rhere each 0^ is a primary eyolio group of order m^, 102^- 
Jhe m^,. m^. 2 . - -'. “O oalled the iuvariants of the 

finite ahelian group G, and from (A.5) we have. 


r-1 

n = n m^^ 
i=0 


(A. 6) 


low, consider the set of rings Sj^, leZj.’ 

:he ring of Integers modulo m, and in which addition and 

* J3 4- “K o tH "hVi T*GST)^c't i/0 mod^tilo ui.- 

nultiplication are defined to he with respe 

Thus, if x,yeSj_, 


X + y = (x + y)ni^ , an^ 
x.y = (x . y) 


(A. 7) 


mi 


^ o+ « new ring S whose elements are the 
re may then construct a new ring 

set of all ordered r- tuples: 

A ''1- ar> > with a^eSj^, ieZ^ * (A.8) 

„ d . o a o» “ — » ^0 ^ ^ - 

St = ^ p— 
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4 riM 8 wo define addition and 

If a., bcS, then, in the a®^ ring o w 

multiplication as follows s 

' ' a^> + <b_ T f b„ 2, ■■ > 

^ ^ ^ a n. a^_0» * — » ®'0> ^ r-1' 


+ h « < .^-2’ 

i a.'*'h 




>m » ^^r-2 VaV 2 


+ b^ O^m - » ’ 








(aQ + bQ)j^ > 


(A.9(a)) 


a.b = < ^ t -2 


ao> . <Vl’ V2> ’’0^ 


= r ( a. 


t) -1 ) , C a„ o * by*^2^i3i Q, “* , 

r-1* r-l'^m^_]_’ i- "“r-2^ 


(aQ* bQ)jjj > 


(A.9(b)) 


The number of elements in S is equal to ra^ 

Then, a possible one-to-one mapping between the set of 


>*iveii iDy “fciiB x^uls 


or ^ (n-1) and ring S is gxven oy on. . 

U j X y ** f ^ 

1 = (»r- 2 * '“r -3 — “oK -1 ^“r- 5 - “r -4 


— nio)^r-2 


1 _ + (m^. mg) a2 + ®'l 


+ l.ar 


(A. 10) 


where le^i 


permits us to represent uniquely 


This rule or mapping per mxoo 

-, c-7. «« an ordered r-tuple < ar_i» ar-2» 


any integer leZ^ as an ora«x«u 
ao> with a,eS,, ieZ,, where 


each is a rxng 


ping of ncsidnc 




olaaa »o<lulo re.ulting repr..«tatl^ 

raferrod to ae the mixed-radix repreeentation of m 

respect t'«3 tJEi# ^ 

' ■*» ^ ' ' -a# 

1^;' member of a cyclic, group ''w^ 

oir'trder m^.thls group being the regular 


C. in equation CA.5)* Then, 




II‘ explained belou, a Tery convenient indexing eoheme for the 
lembers of a finite abelian group S can be obtained ueing the 

mixed-radix number system. 

With respect to the mixed radices “r-2r “ ' 

let le\ have the representation 

1 = ‘ Vi’ V 2 ’ > '^0 ’• 

using equation (A.5). a permutation matrix representa- 

n -v, TT'hir'h the 1 -th member, denoted 
tion of S may be obtained in vbioh 

by pj, is Obtained as 

^ ^r-1 ^-2 (A.ll) 

/ pi is a oyollo permutation matrix which la the l^-th 
where, ma+T*ices of order m-, 

.ember of "the oycllo group of permutation 

7-1 e tes the dl^oot product or Eronecher product of 

and @ denotes the a-r. GO 1/ 

matrices. Now, in the group S, let 


pG pG- = P^ 
V -1 P 


p,k,leZ 


(A. 12) 
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OBlns equation (A.U), we may write 


0 _ T>® e®.= 


SI - Pv . .K ~ 

P 








- X p£ ) 
^0 


^ •«?,, ; -X , ■ '*^1^ ■ . ^ 


* ' . \ ‘‘i ' I# ,/ 1 , 

•ties of EToneoker product# this may be 



>®. P®= (I^^. P^-^)© — ® 

©J::©(p° P? ). 


Recalling that P^. , keZ^, loZ, are all cyclic matrices 


and using equation (A. 4) 


a tjG _ pr-1 . . 

• 1 ^r-1 m. 


®- - © %. + 1 


'r-1 


•1 ■ -I'm. 


®- - © ^(kQ + Iq) • 


Then it follows from equation (A.U) that 


p = < (Vi Vi^iVi’ ^ 




m. 


^r-2 


(ko + - k ©l 


(A. 15) 


Thus, if a, and a^ any two elements of a, then 


®'i* ^0 ^i©3 


i,jsZn » 


(A. 14) 


where i © d denotes poinjwise addition of the integers x and 

3 belonging to Z„ In the mixed-radl. number syatem vr 
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raaiooB - - • »0* 

abelian group a of order a wlib inrarianta dV-2' ■" “ ’ 

mo is oompletsly spsolfled by tbs rule of composition for 
tbs ^roup slsissnt^ a® statsd by equation (A.14) 




is iii3©^ing scheme for members of Gr^ 


.-^.'.effect of ';p^»uting a given n- tuple x = (Xq. x^ - - x^_j_. 

■ . . in .. ■ 


.T^y any memlDer e & may be stated in a compact way as we 
shall presently see. Prom equation (A.11) it follows that 


the 3 -th row of P^ is the direct product of the 


, i .-th row of , 1'- and the jQ-^^ \ 

k„ -, * '^r-2 ^r--2 ■ 


of P^"^ 

S-1 


As seen^from eq^iation (A. 4), the row of Pj^.^ has a 1 in 


— -- 

the (3^ - k^)m -^b position and has zeros everywhere else. 


CC Uriii \ 

Therefore, the^j-'tb row of P^ has a 1 in the (o'r-l " ^r-1 


m 


‘r-l 


( Or -2 " ^ r - 2 ^ m ^_2 » ' ^^0 " ^ 0 ^ 


^r-2 

i.e., (3 - k)-th position and zeros everywhere else. 

Then it immediately follows that if 


-th 7 

mo 




y = X where x = (x^ x^ - - » 


then, 


(y)3 = 


(A. 15) 


i.e., tbe j-th element of y la 

subtraction In the mlred-radix system of numbers, with the 
invariants cl avis., m,.,. 
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it at i on._Matr i c e s 


Then 


Hoxt in importanoe to the nathol of ordering membera 
of 0 using the mixed-radix system, is the set of basic pro- 

perties of these nienihei*s of O'* 


PRl : Pu- P- = Pv 


■3 *k - *k 

PR2 : The set M of matrices Pj^, linearly 

independent. 

PR3 ; The matrices Pj^., keZ^^are orthogonal and 
hence normal.:. 


PR4 : The matrices Pj^, )are periodic matrices, 

that is = I for some integer s; the super- 
script s denotes the s-th power of the matrix Pj^. 


PR5 


The n X n matrix P^^, hsZ^ is equal to the^ 
direct product of cyclic permutation matrices 
Q, of orders m , aeZ , and 

X 

r-x 

m ^ Tii8L'b IS 

1 I y-. cc 

a=0 . , ‘ 


i — ®\©- 





(A. 16) 


where k , are the mixed-radix digits In 

the mixed-radix representation of heZ^ wi 
respect to mixed-radioes ueZ^. 
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A. 5 SiX-SaES.'SsEa 

let S bo a P-I system defined relative to a transitive 
abelian group 0 of permutation matrices, the order of the 
group being n. Therefore, the input signals of S are members 


. Let , the set Sj , jeZ^ be the standard basis of e“. 
i-^V-in' arbitrary input signal reR“ may be written as 
n~l 

x= T ®i ' 

3=0 ^ ^ 

Therefore, 

n-1 ^ n-X 

y= = Io^3 i ' 

J — U j 

V o • P eG- and S P. = P-S from equation 
But since e^ = ®0 ^ 3 3 

(A.l) 

If we call 65 = (1,0, 0)^3 the '.mit sample signal then 

S e„ represents the system's unit sample response. Let 


s*°> S S Sq . 




Then, 


( 0 ) 

3 3 


y = .1 " 


3 =^ 


Using equation (A.15)» this may 


now 


n-1 


he written/ 


; ieZ^; Sj^£s^°^keZ 


s. 


= jlo "3 


©3 


n 


(A. 17) 




‘i 

'-‘-■■■p-v.^ .♦ 

kl-lo, ,.l.,-&-9. , ', . , 


l&e fo 3 f»ttul« 0.rmW W^ation (A* 17)# oalie<2 tiha gene 

rallied conTolutional relationeMp* is comparable 
ordinal disws^s' ooni^clutlonal relationship characterising 

,11 systems. In. this equation, iQd denotes point- 
n of 3 from i in the mixed-radix system of 

3 with respect to the mixed radices 
that are the invariants of group G 
relative to which' the P-I system has been defined. It can 
easily be verified that for the special case of G being a 
cyclic (dyadic) group, equation (A.17) takes the form of a 
cyclic (dyadic) convolutional relationship. 

With respect to the standard basis for equation 

(A.17) takes the matrix form 
y = Sx ^ 

where S, called the system matrix or P-I matrix, is defined 


as 


S= (S^0j) 


i i.jsZ^i ksz„ 


(A. 18) 


A. 6 Properties , of I*- 1 Matrices. 

. A ir^ (k IS) has the following 

The P-I matrix defined as m U.io; 

properties! 

h-x. T,-,Tn-n n-F anv P-I matrix represents 
PEI : The zeroth column 7 j 

the unit sample response S of the r 

represented "by 





PR6 


««. * of stay B-I matrix 8 li 

m2 I Th0 Ic-tii ooli^ s 01 mu^ 

given by 3^''’ - \ a‘°^ 

being the transitive abelian permutation ^ou 
relative to which the P-I system S is defined. 

:, .the prifflifs?- a.iagonal ^ ^ 

; ; , ' ■ iatrir are' all equal to its (0,0)-th element. 

;5Si«^i':^'::i,l^i;,‘i»atrioes are symmetrical about their 
secondary diagonal# 

w n r n matrix S is a P-I matrix iff it is a 
a linear combination of the permutation matrices 
P el, keZ , where 9 is a transitive abelian 
permutation group. 

P-I matrices of order n representing a class of 
P_I systems of dimension n, defined with respect 
to a transitive ahelian permutation group G, 
constitute a vector space of dimension n; the 
set M of matrices P^, representing^ 

elements of the group G^^is a basis of this 

■vector space. 

It was mentioned earlier (PR3 of permutation matrices) 
that the permutation matrices P^c9 are normal and we know they 
commute paiS-wise. being members of an abelian group. They 
are therefor^ unitarily similar to diagonal matrices. In 

^ P -s have a common set of n linearly independent 
other words, \ s nave 

. H-u + are paii5wise orthogonal. Then from pro- 
eigen vectors that are pairr»i» 

perty PE6 of P-I matrices, it follows that 

PR7 • The n X n P-I matrices representing a class of 
’ P-I systems, have a common set of n linearly 
independent pairwise orthogonal eigenjeotors. 
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PR8 . «»trioaB «•<= Unear 

0Oiil>ii»tlo»i of yooti of unity. 




jt. 


a oyollo permutation matrix s*h as 
' ciefer to equation A. 16) has the following 

'* ■ «• „ eigenvalues > 

et of m„ eigenvectors and eig 

B p 2? , 


k„, PeZ , aeZ^ , 


(A. 19) 


= Yr 


• 6 , k f oceZ 


(A. 20) 


where y- 


Yja = exp(f-l ^ ) • 


(A. 21) 


Thus, modal 


matrix of la given hy 


= [ 9ui I ' 

“a ! a I 




1 . I m^-1 

^ P I _ - - I T 

I 0) , ^m 

1 K ; 


“ 1 • 


(A. 22) 


Since equals the dir 


eot product of the cyclic permutation 


Since X, ^v, P keZ 

n It eZ aeZ , it follows that each P^, n 
matrices la ' i* 


< to 0 has * moiex matrix <*10“ 1» 
belonging to 0 “*• oo„,tltuant oyoUo por- 

^oluot ot the .01^ matxlooo o*^^^ ^ 

Effatfttton aa-trioo® %e f os a^' ** dii*©ot ppoduot of 

©igoaf#<^wt' iw«r _.^„U. ^ ^ i ,... 




*' ., ■ 4 '^tli - and (where 3 qj» 




in tho sxpaneion of ''1th 


nixed radioes «„, «eZ^) oigonyeotore of 

- and Qt. rospootiToly. Therefore, 


andQ. rospootlvely. Therefore, 
*^0 


4 


where » 


9, 


’a 


m 


a 


and. 


* DO. a ■ . 

“ 1 .,. is given by 

.bercfore, the i-th conponent of h^. vxs., h. 


i • ' ' 3^ ■ ' ' 

cd' a— 3C 

1^-^“ X X tPjjj 

“"r-l 


3 23^ Pja 

d fY '' UL V * 

X '■ ““ 

(.^1)3 

■ "H 

3a ’ ’ 


■■ expff-1 ' “^^r- 



(A- 23) 


a\T 


j^i,j 

XI 


ly-l ^r-l_ _ y 

'Im , “a 

r-1 






^0 ^0 


- - Y 


m, 


‘0 


r-1 ia 
a=0 a ^ 


(A. 24) 


,=incnts in the expansion 
/ - 'yfZ are the mixed-radix dit>i 

^rherei i^, arc i ^ 

•r^^rvt to the mixed radices n » r 

of ieZj, with respect to tne 




Likowlae, the 3-th olgonvalue of Pj^ is ogual to 

the product of 

values of its oonetituent oyollo permutation matrices 
n I'-- Q ‘-l~andQv respectively. Therefore, 


k 5,' 

r«*# 






or. 


3y«i»^r-l Ja*\ 


- ■ - a. 





ra, 




m 


a 


J o» ^0 

7 . 

m-r. 


But since •, equation A.20), 

“a a 

we have , 


- 


n 


= Y 


’^'r-l^r-1 


m 


Y 


^r-1 


m 


'a 


“ Y 


.-jo ^0 


r-1 

n 

a=0 


n Y, 


“a 


= h^’^ 

n ) 


(A. 25 ) 


where,' h^”^ is complex conjugate of h^^ . 

As mentioned earlier, are simultaneously diago 

nalizahle, and the pertinent modal matrix is then given by 


I ^ < 

t ' 1 . » 

0 ? V.1 \ 


\ 1 - 'i *'n I - - 


(A. 26) 


I 1 ^ 


where h^, the eigenvector is given by equation (A. 23). 

Remark,. l: The eigenvectors hj, j®2^» constituting the columns 

of the modal matrix are Levy’s discrete generalized Walsh 


functions'. 
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Remark 2 t The modal matrices belong to the family of 
generalised Hadamard matrices introduced by Butson, and are 
symraotric and in the standard form. 

The modal matrix satisfies the relationship 
= nl^ where H* denotes the complex conjugate transpose 
of and is the n x n identity matrix. Thus ^ 

Rema rk A i Prom properties PR6 and PR? of the P-I matrices, 
it follows that h^, je2^ constitute a set of n pairwise ortho- 
gonal linearly independent eigenvectors common to the entire 
class of P-I systems defined with respect to the transitive 
abelian group of permutations, Gr. 

A . 8 G-eneralized , Wal sh -H_a dam ard . Tr an sforms, 

The eigenvectors h^, je2^ being linearly independent, 
constitute a basis for the n-tuples x = (xq, x^, - — , 
in C^. That is, we have 



n-1 

.io 


y X. h^ 


This may eq.uivalently be written as 


X = X , 

n n I 


where ^ 




[h^ 1 hj 

n I n 


Ch 


(A. 27) 
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By referring to Remark 3, we may now write 

I * . (A. 28) 

Equations (A. 27) and (A, 28) can alternatively be expressed in 
the form 


n-1 




= h Jo 


jeZ, 


n ? 


(A. 29) 


and 



n-1 


J 




D=0 


^0 



(A. 30) 


pef initiqn_A*2 : The pair of equations (A, 27) and (A, 28), or 
alternatively (A, 29) and (A, 30) will be called the generalized 
Walsh-Hadamard transform (GrWHT) pair. X will be said to be 
the GWHT of x, and x the inverse GWHT of X. 

Remark_3,* matrices associated with the liPT and DWT are 

special cases of the generalized Hadamard matrix Conse- 

quently, the IPT and DV/T are themselves special cases of the 
GWHT. 


Remark^^i A generalization of the IFT and D¥T, the GWHT 
satisfies a generalized convolution theorem which states that 
the GWHT of the generalized convolution of two signals .. 
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(n-tuplea) Is equal to the pointwiss product of tli© gonora- 
lized Walsh Hadamard transform of the individtml signals. 
Thus, if the generalised convolution of two signals s and x 
is given by 

© 3 "'j ' 

therv' 

\ ^ ^k ^ ^®^n , (A. 32) 

■whores Y-^, Sj^^and I.^ are the k-th components of the GWHT’s 
of respectively y, s^ and x. 

Prom equation (A. 32) of remark 6 it follows that the 
transfer function of a P-I system may simply be taken as the 
generalized Walsh Hadamard transform of its unit sample 
response. 


! 



APflSNMl B 

IffiOJP'CiMC PRODUO® (F MATRICES 


This appendlac gives some useful rosults pertaining 
to the Kronecker product of matrices C31|41>493« A genera- 
lized method of writin,; down the product matrix is discussed 
' -fim 

suad some of. the important properties ofykroneoker produotii' 

are' given* 

B.l J&pnecker Product M atr i x 


If A is ahm r n matrix and B is a p x q matrix, the 
ICronecker product of A and B (in tliat order), denoted by 
A(^B, is generally defined to be the mp x laq matrix given 
by 


A(x) B = 


'^0,0 ® 
"^ 1,0 ® 


^■0,1®* * 




, Eo T B 

0 , n-1 

a-i T B 

1, n-l 


a,, nr\B a TTB,..a t ^BJ 
m~l,0 m-1,1 ra-l,n-l a 


This method of writin;j down the product matrix makes 
use of the lexicographic way of ordering of pairs of indices 
[41]. In this thesis, a more general way of siting down 
the Kronecker product of matrices is made use of. In this 
method, the product matrix of two permutation matrices p„ 

f . 

of si^e ra X m and q of sixe n x n is written down making 
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use of a on®-to-ofto iadox oappiag f 

* 

£ : X # I ■« m* n " 

mis product is denoted here hy the symbol®* 

‘v: Mv 

In , wit lag down this Krone cker produot matrix, m 
note that the k-th column of the product matrix is obtained 
by taking the ICroneckar product pj © whore p^ ia the 
i-th column of the matrix p^ and is the j-th column of 
the matrix q^. 'Val-ues of k corresponding to ,f,)articular 
values of i and obtained by using the 

index mapping f. fhe l~th element of this k-th column of 
the product matrix is obtained by taking the product of the 


t~th element of and the u-th element oi' wliere (t,u) = 


PropertieG ox jfroneejeor 

.£?!0.ducM'' 

PRl. 

(A-j^ + Ap ) B 

= (A^®B) + (A2@B) 

PR2. 

A© (B^ + B 2 ) 

--- (A®B^) + (A®B2) 

PR3. 

qA pB 

= ap ( A © B ) 

PR4, 

(A 

If 

© 

H 

PR5. 

(h h)©(h ^2 

) (A^@B^) (A2®B2) 
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